Анульовано

Mirror/crawl/duplicate an entire (large) website

I need to mirror an entire website - it will be at least a 10gb, probably 20gb or more. So the task is to successfully mirror it, BUT knowing that:

wget is not successful in the task.

HTTRACK is not successful in the task.

Once you identify a way to mirror it, it might take a few weeks of the server/computer running.

Then you could just put the files on a server, and I will download them.

If you message me then I will tell you the website. I can provide some example pages from it that I would want to make sure your mirror task will capture.

Thanks.

Навички: Веб-скрапінг, HTML, Python

Деталі: large website bids, testing website functionality running scripts, end large website, large website navigation icons, building large website, seo large website, rip entire flash website, large website databases, allow large website uploads, duplicate document checker website html, large website design proposal, net website slow running local, hosting large website, copy entire images website, copy entire flash website, copy entire javascript website, designing large website php, duplicate joomla virtuemart website

Про роботодавця:
( 3 відгуки(-ів) ) new york, United States

ID Проекту: #22154371

26 фрілансерів(-и) у середньому готові виконати цю роботу за $522

dreamci

Hello! I have more than 15 years development experience and a great team, we can complete your project with clean code and best practices Our current rate is 40 usd per hour and service quality is excellent Please c Більше

$500 USD за 5 дні(-в)
(79 відгуків(и))
8.1
uhjk

Hello, can you please send me website url? I can use php script to download whole website. Thank you.

$750 USD за 14 дні(-в)
(447 відгуків(и))
8.0
Bluesky122

Hello, how are you? Python is my top skill and I have rich experience and expertise in web scrapping. I am familiar with following python libraries for web scrapping: Scrapy, Selenium, Beautiful Soup. I will give you Більше

$500 USD за 7 дні(-в)
(47 відгуків(и))
6.4
ptykamikaze

Hello! I have great skills and had previous experience migrating large sites. I'm available to work together with you and mirror your site

$400 USD за 4 дні(-в)
(44 відгуків(и))
6.2
spryox

Hi, Need to check the LINK of the WEBSITE that needs to be MIRRORED. I am not experience in PYTHON but can get your UI thing sorted. Be assured of quality and timely delivery as I have 9 years of working experience in Більше

$250 USD за 3 дні(-в)
(122 відгуків(и))
5.9
anashakim

Hi, Im developer with 4y experience. I'm free and ready to start right now please contact me for more informations. Thank you.

$450 USD за 7 дні(-в)
(6 відгуків(и))
5.3
NavyaSales

Hi, Based in Bangalore, I am an ex-Microsoft employee and a Full stack Angular.js/HTML/CSS/PHP/WordPress/Python/JavaScript developer & a Graphic Designer with 6-7 years experience of developing sleek, hassle-free & pi Більше

$750 USD за 7 дні(-в)
(31 відгуків(и))
5.4
topexpert713

Hello, Hi, Nice to meet you! I have read your requirements carefully and I am very interesting for your project. I am confident of this project as I'm a professional Python,Scraping expert with over 5 years of experie Більше

$500 USD за 7 дні(-в)
(34 відгуків(и))
5.6
rxhector2k5

15+ years custom php/data-mining/scraping multi-curl to the rescue ;) please msg me site and info i will take a look thanks, joe $your_results = $choose_me ? $success : $fail;

$500 USD за 7 дні(-в)
(17 відгуків(и))
4.6
liujianmin

Great! How are you,sir? Thank you for visiting my proposal. I've just read your job post carefully and much interested in your project and I am sure I can complete this in time perfectly as you want. I'm full stack pro Більше

$450 USD за 7 дні(-в)
(31 відгуків(и))
4.5
JinTai

Hi I just read your posting. Sounds like you need some help for clone of entire website. I can help you with that and start right now. I ve background in cloning. I am python & node.js expert. If any of the above sound Більше

$1500 USD за 14 дні(-в)
(1 відгук)
2.7
athminteam

Hi, This is Vipin. I have 6+ years of experience in web development and has expertise in Python, PHP, HTML, Angular and Ionic framework. I have gone through your project description and would like to work on your pro Більше

$500 USD за 7 дні(-в)
(2 відгуків(и))
2.8
Lijingri

Dear sir I have rich experiences in web scraping. I can start right now and can finish for a short time. My work method: 1. If selected for the project, I would like to begin with a Interview to discuss the requirement Більше

$300 USD за 7 дні(-в)
(3 відгуків(и))
2.9
k551244

Hello.. I have read your post very carefully and I have understood what you want. What is your website url? Let me know if you have some time to discuss the details further. Looking forward to hearing from you. Sincere Більше

$500 USD за 7 дні(-в)
(3 відгуків(и))
2.5
wangzy840101

Dear Client. I respect you and will follow all your requirements. I am so happy to see your serious project. Because your project is the perfect match for my skills and experience. I have strong skill and rich experien Більше

$400 USD за 7 дні(-в)
(2 відгуків(и))
2.3
saadtariq329

Your project's posting has caught my attention as this lies exactly in my domain of expertise. To ask a few questions & to gather all the requirements for this project, i request you to message me. Expertise and skill Більше

$500 USD за 7 дні(-в)
(1 відгук)
2.1
gopalkrgautam

Hi, I have strong experience in Web-Scrapping and Web-Crawling using Python. Kindly ping me and discuss more about the project. I'd be glad to help you in crawling the images. Thank You!

$400 USD за 7 дні(-в)
(2 відгуків(и))
1.8
sd0401

Hello. I had experience of doing project of mirror website. I can help you to complete your project.

$500 USD за 7 дні(-в)
(1 відгук)
1.6
Artemrodin1987

Hello, I have just read your requirement carefully and I am very interesting with your project. Webscraping is my top skill. No problem for everything!!! I can complete your project using spider or selenium etc in pyth Більше

$400 USD за 3 дні(-в)
(1 відгук)
1.6
tgltech

Hi, I have gone through your requirements " Mirror/crawl/duplicate an entire (large) website " and having experience in similar work, I can very well assist you from start to end till your satisfaction. We have Excel Більше

$418 USD за 7 дні(-в)
(1 відгук)
1.1