Mirror/crawl/duplicate an entire (large) website

I need to mirror an entire website - it will be at least a 10gb, probably 20gb or more. So the task is to successfully mirror it, BUT knowing that:

wget is not successful in the task.

HTTRACK is not successful in the task.

Once you identify a way to mirror it, it might take a few weeks of the server/computer running.

Then you could just put the files on a server, and I will download them.

If you message me then I will tell you the website. I can provide some example pages from it that I would want to make sure your mirror task will capture.


Навички: Веб-скрапінг, HTML, Python

Деталі: large website bids, testing website functionality running scripts, end large website, large website navigation icons, building large website, seo large website, rip entire flash website, large website databases, allow large website uploads, duplicate document checker website html, large website design proposal, net website slow running local, hosting large website, copy entire images website, copy entire flash website, copy entire javascript website, designing large website php, duplicate joomla virtuemart website

Про роботодавця:
( 3 відгуки(-ів) ) new york, United States

ID Проекту: #22154371

19 фрілансерів(-и) готові виконати цю роботу у середньому за $478


Hello! I have more than 15 years development experience and a great team, we can complete your project with clean code and best practices Our current rate is 40 usd per hour and service quality is excellent Please c Більше

$500 USD за 5 дні(-в)
(91 відгуків(и))

Hello, can you please send me website url? I can use php script to download whole website. Thank you.

$750 USD за 14 дні(-в)
(537 відгуків(и))

Hello! I have great skills and had previous experience migrating large sites. I'm available to work together with you and mirror your site

$400 USD за 4 дні(-в)
(55 відгуків(и))

Hello, how are you? Python is my top skill and I have rich experience and expertise in web scrapping. I am familiar with following python libraries for web scrapping: Scrapy, Selenium, Beautiful Soup. I will give you Більше

$500 USD за 7 дні(-в)
(47 відгуків(и))

Hi, Need to check the LINK of the WEBSITE that needs to be MIRRORED. I am not experience in PYTHON but can get your UI thing sorted. Be assured of quality and timely delivery as I have 9 years of working experience in Більше

$250 USD за 3 дні(-в)
(132 відгуків(и))

Hi, Im developer with 4y experience. I'm free and ready to start right now please contact me for more informations. Thank you.

$450 USD за 7 дні(-в)
(6 відгуків(и))

Hi, Based in Bangalore, I am an ex-Microsoft employee and a Full stack Angular.js/HTML/CSS/PHP/WordPress/Python/JavaScript developer & a Graphic Designer with 6-7 years experience of developing sleek, hassle-free & pi Більше

$750 USD за 7 дні(-в)
(32 відгуків(и))

15+ years custom php/data-mining/scraping multi-curl to the rescue ;) please msg me site and info i will take a look thanks, joe $your_results = $choose_me ? $success : $fail;

$500 USD за 7 дні(-в)
(17 відгуків(и))

Hello. I had experience of doing project of mirror website. I can help you to complete your project.

$500 USD за 7 дні(-в)
(4 відгуків(и))

Hi, This is Vipin. I have 6+ years of experience in web development and has expertise in Python, PHP, HTML, Angular and Ionic framework. I have gone through your project description and would like to work on your pro Більше

$500 USD за 7 дні(-в)
(2 відгуків(и))

Hi, I have strong experience in Web-Scrapping and Web-Crawling using Python. Kindly ping me and discuss more about the project. I'd be glad to help you in crawling the images. Thank You!

$400 USD за 7 дні(-в)
(9 відгуків(и))

Dear sir I have rich experiences in web scraping. I can start right now and can finish for a short time. My work method: 1. If selected for the project, I would like to begin with a Interview to discuss the requirement Більше

$300 USD за 7 дні(-в)
(4 відгуків(и))

Dear Client. I respect you and will follow all your requirements. I am so happy to see your serious project. Because your project is the perfect match for my skills and experience. I have strong skill and rich experien Більше

$400 USD за 7 дні(-в)
(2 відгуків(и))

Your project's posting has caught my attention as this lies exactly in my domain of expertise. To ask a few questions & to gather all the requirements for this project, i request you to message me. Expertise and skill Більше

$500 USD за 7 дні(-в)
(1 відгук)

Hello, I have just read your requirement carefully and I am very interesting with your project. Webscraping is my top skill. No problem for everything!!! I can complete your project using spider or selenium etc in pyth Більше

$400 USD за 3 дні(-в)
(3 відгуків(и))

Hi, I have gone through your requirements " Mirror/crawl/duplicate an entire (large) website " and having experience in similar work, I can very well assist you from start to end till your satisfaction. We have Excel Більше

$418 USD за 7 дні(-в)
(2 відгуків(и))

Hello Dear Employer I think it can be done successfully by Python. Please tell me the url and samples. If I can do it, please more discuss. I just have checked the job post and I think I am a right candidate for you Більше

$500 USD за 2 дні(-в)
(1 відгук)
$555 USD за 10 дні(-в)
(0 відгуків(и))

We are from Litost India is a leading Digital Marketing Company & certified for Google Ads Search. We offer a comprehensive suite of IT Solutions, including web solutions and web applications services along with state- Більше

$500 USD за 7 дні(-в)
(0 відгуків(и))