• 0

Need help making an "offline" copy of a website I'm a member of


Question

Hi, everyone.

I'm a member of a private group, one that costs many thousands of dollars to join. The person that started the group and runs it, I'll call "Bob", isn't very technical at all. He hired someone to create a website for members. Each member has their own username and password. As far as I know, for at least the last few years Microsoft SharePoint Server has been used. I do not know any more specifics about what the website is running on.

"Bob" has always encouraged people to download things from the website here and there since content is always changing and in case anything ever happened to the server. Well, this website has many areas (called "Sites"), thousands of forum/blog type postings, and hundreds or thousands of links, files, and folders scattered all over the place. Yes, I could manually make local folders and download things, but that would be a nightmare and quite difficult.

So, all along over the last year or so, I've thought about just making an "offline" copy and figured I would use WinHTTrack, which I have known about for many years. I went to do it about a week ago, with the intention of backing up the site to a new Western Digital Caviar Black 2TB drive. I think the website is only maybe 100GB. Anyway, I am getting "Access Denied" and "Unauthorized" errors (if I look at the logs), which don't make any sense when I know I am using the correct username and password that I use to login. I am even copying and pasting from my password manager.

Here is the log file generated when telling WinHTTrack to copy http://www.WEBSITE.com :

HTTrack3.46+htsswf+htsjava launched on Wed, 17 Oct 2012 14:12:40 at http://USERNAME:PASS...www.WEBSITE.com +*.png +*.gif +*.jpg +*.css +*.js -

ad.doubleclick.net/* -mime:application/foobar

(winhttrack -WC2%Pns2u1%s%uN0%I0p7DaK0c2R3H0%kf2A25000%c1%f#f -F "Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)" -%F "<!-- Mirrored from %s%s by HTTrack Website

Copier/3.x [XR&CO'2010], %s -->" -%l "en, en, *" http://USERNAME:PASS...www.WEBSITE.com -O1 I:\WEBSITE_BACKUP_FOLDER +*.png +*.gif +*.jpg

+*.css +*.js -ad.doubleclick.net/* -mime:application/foobar )

Information, Warnings and Errors reported for this mirror:

note: the hts-log.txt file, and hts-cache folder, may contain sensitive information,

such as username/password authentication for websites mirrored in this project

do not share these files/folders if you want these information to remain private

14:12:42 Error: "Access denied" (401) at link USERNAME:[email protected]/ (from primary/primary)

14:12:42 Info: No data seems to have been transfered during this session! : restoring previous one!

Here is the log file generated when telling WinHTTrack to copy http://www.WEBSITE.com/default.aspx :

HTTrack3.46+htsswf+htsjava launched on Wed, 17 Oct 2012 14:16:53 at http://USERNAME:PASS...om/default.aspx +*.png +*.gif +*.jpg +*.css +*.js

-ad.doubleclick.net/* -mime:application/foobar

(winhttrack -WC2%Pns2u1%s%uN0%I0p7DaK0c2R3H0%kf2A25000%c1%f#f -F "Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)" -%F "<!-- Mirrored from %s%s by HTTrack Website

Copier/3.x [XR&CO'2010], %s -->" -%l "en, en, *" http://USERNAME:PASS...om/default.aspx -O1 I:\WEBSITE_BACKUP_FOLDER +*.png

+*.gif +*.jpg +*.css +*.js -ad.doubleclick.net/* -mime:application/foobar )

Information, Warnings and Errors reported for this mirror:

note: the hts-log.txt file, and hts-cache folder, may contain sensitive information,

such as username/password authentication for websites mirrored in this project

do not share these files/folders if you want these information to remain private

14:16:56 Error: "Unauthorized" (401) at link USERNAME:[email protected]/default.aspx (from primary/primary)

14:16:56 Info: No data seems to have been transfered during this session! : restoring previous one!

Attached you will find an a screen-shot of the error I get via a pop-up window (for WEBSITE.com or WEBSITE.com/default.aspx) as well as screen-shots showing the various tabs of the Preferences.

So, I was wondering if there is a problem in general with using WinHTTrack with SharePoint websites? Does anyone have any experience making offline copies of SharePoint websites? Any suggestions? Other software that someone has used for SharePoint websites?

Thanks in advance for any feedback and/or help...

-JayZJay

post-157395-0-82868200-1350509533.jpgpost-157395-0-21688800-1350509544.jpgpost-157395-0-71445100-1350509545.jpgpost-157395-0-52917400-1350509547.jpgpost-157395-0-78965000-1350509548.jpgpost-157395-0-17525600-1350509550.jpgpost-157395-0-44106700-1350509551.jpgpost-157395-0-70143500-1350509552.jpgpost-157395-0-07401200-1350509554.jpgpost-157395-0-25737800-1350509555.jpgpost-157395-0-60818300-1350509556.jpgpost-157395-0-82880800-1350509557.jpg

10 answers to this question

Recommended Posts

  • 0

Why not just do it at a server level backup. I never had any issues with the standard options in httrack in getting websites. Or just FTP into the server and DL the entire website from there. If it uses PHP I believe you still will need a local server to run the website.

  • 0

The server is not physically here, nor do I as only a member have any type of admin access to do a server level backup. As far as I know or can tell, there is not any type of ftp access available to anyone. If there is, I do not know the URL and "Bob", being a control freak, is not going to provide that information to any of us members.

  • 0

well from this

"14:12:42 Error: "Access denied" (401) at link USERNAME:[email protected]/ (from primary/primary)"

Looks to me that you can not use that form of url to auth to the site? If sharepoint its prob using ntml auth, and they prob have basic auth off so you can not do that sort of url to auth.

your never going to download anything if site requires auth to access. I would verify that you can use that url your using just in your browser address bar to access the site. If not then do a bit of google for how to use ntml auth with httrack, the old school was was to use a proxy with httrack that would do the ntml auth for you and then all the connections from httrack would use the local proxy you were running on the same machine. Have not play with httrack in years and years - maybe they support direct ntml auth now?

  • 0

"Bob" runs a website where he encourages people to download, yes sounds very legit...

Try not assuming. It is a research group. We study alternative health, banking, law, trusts, estates, and other topics. The only thing on the site is PDFs, Word docs, discussion on various topics, private presentations recorded from group meetings, webinars, etc. Those are the things on the site and there is a ton of it going back years. "Bob" encourages us to download and keep copies of stuff because 1) the site constantly changes, 2) there are times when you are in a law library or other place without Internet access and cannot access the site, and 3) "Bob" isn't very technical and he loses things, deletes stuff, etc -- so having our own backup copies is certainly a good idea just in case a problem arises.

  • 0

Try not assuming. It is a research group. We study alternative health, banking, law, trusts, estates, and other topics. The only thing on the site is PDFs, Word docs, discussion on various topics, private presentations recorded from group meetings, webinars, etc. Those are the things on the site and there is a ton of it going back years. "Bob" encourages us to download and keep copies of stuff because 1) the site constantly changes, 2) there are times when you are in a law library or other place without Internet access and cannot access the site, and 3) "Bob" isn't very technical and he loses things, deletes stuff, etc -- so having our own backup copies is certainly a good idea just in case a problem arises.

i dont know how to help, but this sounds really cool. Why can't we know who bob is, or this website?

  • 0

Try not assuming. It is a research group. We study alternative health, banking, law, trusts, estates, and other topics. The only thing on the site is PDFs, Word docs, discussion on various topics, private presentations recorded from group meetings, webinars, etc. Those are the things on the site and there is a ton of it going back years. "Bob" encourages us to download and keep copies of stuff because 1) the site constantly changes, 2) there are times when you are in a law library or other place without Internet access and cannot access the site, and 3) "Bob" isn't very technical and he loses things, deletes stuff, etc -- so having our own backup copies is certainly a good idea just in case a problem arises.

All i have gotten from this whole thread is bob is a complete and utter idiot that runs a website that people seem to pay alot of money to join. If you are paying him money to join this secret website and he has no clue on what he's doing then he should hire someone to take care of the tech side of things including backups to another hard drive/server (after all you say your paying alot of money why can he not have more than one server?). If there are so many files like you claim then the best thing would be to get limited ftp access to the downloads directory (can access and download that directory and thats it).

In all honesty you would be better talking to this bob and telling him to hire someone for back up reasons, as for the offline content maybe he does not want that because the information could end up being on the internet for free instead of people paying him to gain access. As you said things change and people leave things laying about which soon gets onto the internet,.

Anyway im out of this thread, i personally think what you are doing is wrong you are a member of a site and nothing more.

This topic is now closed to further replies.
  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Posts

    • I notice how you dodged the questions I had about the racism shown by ignorant, gullible, cowardly people when the Poles, like your partner, were the immigrants. Ahem. I wonder how you'd feel if native born Brits suddenly treated you as "dirty crooked immigrant" for being half Trump-American? If they ordered you to leave and "go back to your corrupt country" (on the other side of the Atlantic), would you go? The truth is based on facts as supported by evidence. As requested in your previous posts, I have used the facts in your own post to show everyone the truth.
    • US citizens are paying to their government, who could use that to fund healthcare and tuition and relieve the costs of these for citizens instead of making tax breaks that overwhelmingly favor the rich. I'm not saying that tariffs are the correct solution, but what else would they be used for? What else could Trump have in mind for wanting them, if he hasn't figured out that labor costs are higher in the US?
    • I’m in need of a new chair and it sounds like the backrest cannot be locked? I also sat on a Herman miller and was devastated that it couldn’t be locked also, what is going on with chairs. I want to be able to lock the backrest into any position but not even the Herman’s do that
    • Sihoo Doro C300 Pro V2 Ergonomic Office Chair review: The Ikea of chairs by Steven Parker I've reviewed a few gaming chairs over the past three years or so and generally found them to score well in our reviews. SIHOO reached out asking if I was interested in taking a look at their flagship chair, the Doro C300 Pro V2. I never got the chance to check out its predecessor, but the V2 is described as an "Adaptive Ergonomic Chair." It became available to buy in April of this year. Let's get things rolling with a closer look at the specifications and features. Specifications Doro C300 Pro V2 Model Ergonomic Materials Mesh Back and Seat; Soft PU Coated Armrests Height adjustability 45.5 - 53 cm / 17.5" - 20.9" Seat (w+d) 52 x 43 - 47 cm / 20.5" x 16.9" - 18.5" (adjustable) Backrest 52 – 60 cm / 20.5" - 23.6" (adjustable) Lumbar support Mesh built-in (adjustable) Armrest adjustability 8D Bionic Armrests Rocking angle 105°, 120°, 135° (fixed) Neck support Mesh built-in (adjustable) Net weight 27.3 kg / 59.64 lbs Weight support 150 kg / 330 lbs Colors Black, White Warranty 5 years (upon registering) Price $499.99, $539.99 Introduction At first glance, it looks like a chair that in another life wants to be a Herman Miller; It certainly looks like my Aeron Remastered, but the Doro C300 Pro V2 has quite a few more features and costs quite a bit less. SIHOO says that it is made up of a "DynaCore" system that tracks your movement and synchronizes the headrest, backrest, lumbar support, and armrests as you shift, twist, or recline. They also say that the "SyncroFlex Backrest" molds to your spine, which kind of describes how the mesh fabric works in most ergonomic chairs, but anyway. Below are the meat and potatoes measurements for the chair. Here is the same tech sheet, but in inches. Durability I would be remiss to not talk about the various durability testing this chair underwent before coming to market, as this is claimed on the product page. First of all, the chair is BIFMA-, SGS-, and TÜV-certified. As for durability, the tests undergone were: 100,000 Castor cycles tested 120,000 Armrest cycles tested 120,000 Recline cycles tested 120,000 Gas lift cycles tested 60,000 Armrest durability cycles tested 120,000 Rotation cycles tested Nothing about weights testing, though. Now that's all disclosed, now onto my own personal findings. Assembly The Doro C300 Pro V2 came in two large boxes (1) (2), and everything was packed very well, protecting the different parts of the chair. In the box, there is a folded sheet that explains the 12 steps to assemble it; they are: Remove the bottom cover on the aluminum base; Insert the five legs into the aluminum base and use ten screws to fasten them; Insert the castors into the legs; Replace the bottom cover on the bottom of the aluminum base; Place the Class 4 Hydraulics gas cylinder into the aluminum base; Screw the bottom part of the arm rests, taking care of the orientation using two screws on each side; Use three torx screws to fasten the footrest to the bottom of the seat; Fasten the backrest to the seat using four torx bolts; Fasten the armrests to the backrest using four Torx bolts (two on each side), taking care to note the orientation; Place the chair onto the Class 4 Hydraulics gas cylinder; Insert the headrest into the top of the backrest; Use two torx screws to fasten the headrest to the backrest. There's also an online guide you can refer to. Carefully unpacking the two boxes took around 15 minutes because almost everything is wrapped in plastic and protective foam; the chair assembly itself took around an hour. I say in the above assembly steps to take note of the orientation, because it's not obvious which way around the bottom portion of the armrests go, and although there is an L and R on the bottom of the armrests, it also wasn't clear from the instructions which was actually left or right, facing the chair, or in the seated down orientation? Anyway, I ended up putting the bottom portions on the wrong sides, and after securing one of the armrests, I discovered that although it was on the correct side, the armrest base could rotate a full 360°, but not when bolted to the chair, so I had to remove it, rotate it, and then bolt it back on. Truly an Ikea experience! Also, to complicate things further, although all the parts are labeled from A to X (yes, that's 24 parts) unhelpfully, these letters do not appear on the parts themselves or the package with the bolts, screws, and washers. There's also a pair of protective gloves in the box, but I think they were made for much smaller hands than I have. Even my friend, who is 5.1, had difficulty putting them on. Once assembled, I needed to sit down. Anyway, as I said, it looks quite similar to my Herman Miller. And here is the back of it. If you look at the product page and on Amazon, it seems like a lot of thought has gone into the chair itself and what it's capable of, but there is no mention at all about the castors, and this is an area where I think the chair trips up quite quickly. I found it difficult to move the chair in any direction. I asked a friend who came to visit me earlier this week to test my findings, and she said that the wheels were "no good," so it definitely isn't just me. I am 6'2 myself and a big guy, I work from home and gained a few pounds from mostly staying in and the hell away from other people. However, the Doro C300 Pro V2 is rated for up to 150kg (330lbs), which in my case is used well within its max rating. Ergonomics The number of adjustments you can make, right up to setting it in nap mode — which I haven't fully tested yet — is what you'd expect from a premium chair. Yes, you can go up and down (max 7.5 cm adjustment), rock back and forth (with tilt adjustment), and lock the chair between three stages of 105°, 120°, 135°, which is not quite as flat as the AndaSeat I tested at 160°. Some thought has also gone into the "8D" armrests, too, which are cushioned but quite firm; you'll only know it if you press hard into the PU-covered tops, which give about half a centimeter, but it's enough to ensure your skin won't get awkwardly stuck to it in warmer (or sweatier) conditions. It almost feels like plastic and is very easy to keep clean. However, the armrest positions move far too easily, and I am not sure what that "elbow" function is. Maybe it is good for a short person with short arms, anyway, I never used it and kept it flat at all times. There are eight levels of adjustment for the armrests, they are: backwards, forwards, swing left/right, height up and down, tilt, and 360° rotation, which can be handy for desk clearance. As I said, the armrest pads shift far too easily, which could give off an ergonomic vibe, but who wants the armrest sliding when you are shifting weight? The height adjustability does lock into place when lifting and adjusting. Comfort This is ultimately what it boils down to at the end of the day, right? Quite a lot of reviews praise the comfort of this chair, and I don't disagree that the mesh seating is quite comfortable. I am used to the material from my daily Herman Miller. However, the backrest cannot be locked into place, and this is actually a feature; as you shift or recline yourself on the chair, the backrest moves with your body. It took some getting used to. The lumbar gives ample support, but I would have preferred an adjustable one built into the seat base, as this causes the backrest to move up and down at will. Again, as with my previous chair review, this chair is also rated for tall people, but nowhere in the product documentation does it say how tall. Being 6'2 myself, I'm happy to say that the backrest is tall and wide enough, and thought has been given to being able to adjust the neck rest, but as others have mentioned in their reviews, people as tall as 6.2ft is about the limit for the neckrest. Conclusion What I didn't like The footrest is rated for 15kg (33 lbs), which to me seems a bit light, and after looking online, it seems like a chair footrest for adults must be at least twice that rating. In all honesty, they are just hollow metal tubes, so it is not recommended to let a kid sit on them. I also feel like it doesn't really go out far enough for my height, so that kind of puts the dampener on me being able to use it regularly. I'll just have to continue to use my subwoofer as a footrest! I do not like the armrests being able to shift around as easily as they can, and they are a little too forward-positioned in the chair to comfortably sit close to my desk, because even in the lowest height position, they don't allow me to go under the desk like is possible with my Herman Miller. I also feel like this chair could have been delivered partially constructed, especially the armrests on the seat, and why the aluminum base wasn't already pre-constructed (without the castors) is baffling, considering it would have fit in one of the two boxes that way. The instructions also need to be clearer. On the pamphlet, there's an A to X listing (which is also used in the steps), but none of the physical parts use this lettering system! What I did like I'll be honest, I haven't used it for very long, just one week, and seating comfort is subjective after all! Any spills wiped straight off it, the stitching, and the lines look great, not a fray to be seen or stitch out of place. It looks kind of cool, too. My favorite feature of these seats is the nap mode. While you're not lying completely flat, it leans far back enough to make you easily doze off after a heavy gaming or working session. Overall, this chair offers plenty of comfort features. The MSRP does vary quite a bit depending on the region, at £549.99 in the UK, and €580 in Europe, and $599 before tax in the U.S. However, shipping is free, which is a bonus for such a heavy item. Is it worth it, though? At three years' warranty, I think it's a decent deal. Another firm out of Germany sent me a free replacement hydraulic gas spring for a chair that failed after almost four years, so it was well outside its two-year warranty. My advice is to always try, as you might have the same luck I did. If I could fault it at all, it would be the constant shifting of the armrests and backrest. Where to buy Although the footrest variant normally costs $539.99, it has been discounted to $469.99 on the official website in Black or White. In fact, the non-footrest variant is only $40 cheaper. On Amazon, it currently costs more at $499.99 links below. Sihoo Doro C300 Pro V2 for $469.99 (official website) Sihoo Doro C300 Pro V2 for $499.99 at Amazon US SIHOO provided a free sample without any review or pre-approval. Good to know This Amazon link is U.S. specific, and not available in other regions unless specified. We only use first-party seller links (at the time of article publishing); ensure that you purchase from a first-party seller link only. Check out Today's Deals on Amazon | or our recent tech deals. Become a Prime member (for Students or SNAP) via Neowin Get Prime Access - Prime for half price (for qualifying Medicaid, EBT, SNAP) Subscribe to Prime Video, Audible Plus, Music Unlimited or Kindle Unlimited via Neowin As an Amazon Associate, we earn from qualifying purchases.
  • Recent Achievements

    • Conversation Starter
      jessse3334 earned a badge
      Conversation Starter
    • Reacting Well
      JuvenileDelinquent earned a badge
      Reacting Well
    • One Month Later
      Excellence2025 earned a badge
      One Month Later
    • Week One Done
      Excellence2025 earned a badge
      Week One Done
    • Week One Done
      flexorcist earned a badge
      Week One Done
  • Popular Contributors

    1. 1
      +primortal
      506
    2. 2
      +Edouard
      207
    3. 3
      PsYcHoKiLLa
      151
    4. 4
      Steven P.
      73
    5. 5
      macoman
      62
  • Tell a friend

    Love Neowin? Tell a friend!