В роботі

create tool / script to scrape similarweb estimated visits of 1,000s of websites a month. Avoiding the API costs

Hello

I currently use SimilarWebs chrome plugin to tell me manually how many visitors websites get each month. I need to scale and automate this process. I could use the similarweb API but they're expensive so I am looking at other options.

I need a tool or script to be able to enter 100s/1000s websites at a time and for it to fetch/find SimilarWebs data on them:

1- Estimated Visits - 100% needed

but if possible I would also like the following values from the chrome plug in

2- the past 6 months of estimated visits - this will enable me to average the data for a better estimate.

3 - The rank of the website within its county

4 - the sector its in, and the rank within its sector - something Similar Web does very well.

NOTES

Need to be careful of high volume of traffic coming from one location, but I am sure this is something that can be done. We could either have a script that visits the [url removed, login to view] website and enters each site, then finds and copies the relevant data into a excel/csv file. Or do the same process from the website direct, using the similarweb plug in. Go to site, click plug in, see and copy data. Both would in theory work.

I would likely do this for 3,000 websites a month to start.

I am interested in hearing about your experihence and how you could build me a tool to do this.

Thanks

Scott

Навички: Інтелектуальний аналіз даних, Excel, PHP, Веб-скрапінг

Показати більше: websites twitter api, freelance websites affiliate api, betfair api costs, keyword tool api costs, weather api costs, google maps api costs, foreca api costs, comparison websites work api, highscore flash api costs

Про роботодавця:
( 28 відгуки(-ів) ) folkestone, United Kingdom

ID проекту: #12019220

Доручено:

Michael91B

Hi, I have reviewed similarweb.com website. I test it with my script and I could easily extract estimated visits, rank within its country, sector and sector rank. And I could probably figure out how to get the past Більше

$280 USD за 7 дні(-в)
(8 відгуків(-и))
3.7

8 фрілансерів(-а) подали заявки на цю роботу; середня заявка - $381

PigtailXL

Hello Sr. I'm Jorge from Argentina, a responsible person who have wide experience working building solutions to automate lot of processes and tasks. I've experience working with WinAutomation since last 2/3 years. L Більше

$380 USD за 5 дні(-в)
(134 відгуків(-и))
6.7
SBITServices

Hello Scott, I have read your description and can complete in 4 days and agree that I can complete tasks with high quality and consistency.We are the best team(8 people) within your budget to complete this project quic Більше

$250 USD за 4 дні(-в)
(110 відгуків(-и))
6.4
dpune

Hi, I have more than 14 years of Excel/VBA exp and I can build similar tool in excel which can scrpe data from the website as required. I have completed more than 290 projects. Please look at the feedback le Більше

$500 USD за 10 дні(-в)
(136 відгуків(-и))
6.3
mwarrenschultz

Hello! I am a professional programmer with many years of experience using Python. I have read your project description, and I can create the SimilarWeb Automation program you require. To do so, I will use the libraries Більше

$333 USD за 10 дні(-в)
(41 відгуків(-и))
6.2
RubyOnRail

Hi,I have gone through your project description. I could be confident if we can proceed towards more discussion. I am an individual developer and you will be working directly with me if we proceed work on this project Більше

$777 USD за 15 дні(-в)
(5 відгуків(-и))
5.5
narsim3128

With respect to this project I would like to present myself as a candidate for your consideration. I have more than 6 years of experience. I have successfully completed few projects for US clients which involved web sc Більше

$250 USD за 7 дні(-в)
(16 відгуків(-и))
3.6
$277 USD за 10 дні(-в)
(2 відгуків(-и))
2.4