I need to mirror an entire website - it will be at least a 10gb, probably 20gb or more. So the task is to successfully mirror it, BUT knowing that:
wget is not successful in the task.
HTTRACK is not successful in the task.
Once you identify a way to mirror it, it might take a few weeks of the server/computer running.
Then you could just put the files on a server, and I will download them.
If you message me then I will tell you the website. I can provide some example pages from it that I would want to make sure your mirror task will capture.
26 фрілансерів(-и) у середньому готові виконати цю роботу за $522
15+ years custom php/data-mining/scraping multi-curl to the rescue ;) please msg me site and info i will take a look thanks, joe $your_results = $choose_me ? $success : $fail;
Hi, I have strong experience in Web-Scrapping and Web-Crawling using Python. Kindly ping me and discuss more about the project. I'd be glad to help you in crawling the images. Thank You!