Complex data mining project. Create and populate MySQL database with data obtained from single website.

$250-750 AUD

Завершено

Опублікований

about 10 years ago

$250-750 AUD

Оплачується при отриманні

Stagecoach Software Pty Ltd wishes to obtain a large data set available from a particular website. The data is not readily available as a large set but is only presented upon particular queries being made on the site. However, it is believed all data can be obtained through accessing a site API. The data is available in standardised format. It is hoped that hundreds of thousands of data rows can be obtained. The data must be parsed into a MySQL database created by the freelancer. The database only needs one active table. It will require 12 columns of normalised data. Substantial ruby code for normalisation has already been written for the project of which this is a part. If needed, that code will be made available to the freelancer although it may require some modification. The final outcome required is the presentation of a MySQL database containing all available data as described above. Full written instructions including the site address will be provided to selected bidders. Bidders are free to revise or withdraw their bids before acceptance upon studying the instructions. This project is akin to sinking a very deep drill down a very narrow mineshaft!

MySQL

Web Scraping

ID проекту: 5478356

Про проект

21 пропозицій(-ї)

Дистанційний проект

Активність 10 yrs ago

Хочете заробити?

Переваги подання заявок на Freelancer

Вкажіть свій бюджет та терміни

Отримайте гроші за свою роботу

Опишіть свою пропозицію

Реєстрація та подання заявок у проекти є безкоштовними

Доручений:

@nmarkovickv

A proposal has not yet been provided

$526 AUD за 5 дні(-в)

5,0

(79 відгуки(-ів))

6,9

21 фрілансерів(-и) готові виконати цю роботу у середньому за $559 AUD

@mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$621 AUD за 6 дні(-в)

5,0

(284 відгуки(-ів))

7,5

@cheapexcell

Hello Sir, I am an expert in web scraping. I am currently ranked #1 for Web Scraping https://www.freelancer.com/freelancers/skills/Web_Scraping/ Please provide the details. Thanks, Alex

$721 AUD за 20 дні(-в)

5,0

(181 відгуки(-ів))

7,1

@alizza

Hello Web Scraping and Data mining Expert here.I can help you with Complex data mining project. I assure you 100% accurate and high quality results. Waiting for your positive responds to discuss furthermore about this project. Thank you

$277 AUD за 10 дні(-в)

5,0

(67 відгуки(-ів))

6,8

@SuiGenSolutions

Hi, We are team of developers proficient in web scraping and data mining domain. We have over 100 projects completed in this domain with full client satisfaction. Our team can finish this job efficiently and quickly. Looking forward to hear from you. Thanks Shiv Agrawal SuiGen Solutons

$333 AUD за 10 дні(-в)

4,9

(72 відгуки(-ів))

6,4

@ghazalpasha

I've done many successful scraping jobs with 100% completion rate and 5 star feedback. Please let me know the details of the project and I'll update the bid accordingly.

$666 AUD за 10 дні(-в)

5,0

(35 відгуки(-ів))

5,9

@proauthor

Dear employer, I can scrape the content as per your requirement. I use php/java as the programming language. Please send in the details of the site to proceed with the project. I'm ready to start working on the project. Looking forward to working with you. Awaiting a positive reply from you. Thanking you Shaik Allabakash.

$250 AUD за 9 дні(-в)

4,9

(48 відгуки(-ів))

5,4

@WebDeveloperBR

Hi, I recently scraped a very large site and got a database with almost 60 million entries.. I used multiple servers to speed up the scraping process and a lot of proxies to avoid being blocked.. I've also made a bid on your previous project.. and as I said there: "I'm new as a freelancer here, but I'm a web scraper expert.. I have computer science degree (2007) + specialization in web engineering (2008) and over 14 years' experience with web development (almost 10 with web scraping).." So I think I can help you, but I'd like to know more details about it.. I can't correctly bid without knowing details like: 1) source/scraping difficulty 2) data volume 3) what kind of normalization is needed I'll be waiting for your contact Thanks for your time

$560 AUD за 20 дні(-в)

5,0

(24 відгуки(-ів))

5,5

@iautomationus

Is it ok for the script to be written and run with PHP? We can always make it work with Ruby. From what I'm reading minimal proxies will be needed, but I'm ready in case more are needed. Please send me the website, and if needed the specific data scraping instructions; and I'll get back with you with a more accurate quote. Feel free to contact me regarding any questions. I apologize for the lack of portfolio items on Freelancer regarding scraping, but be assured I'm well experienced. Thanks, Josh

$488 AUD за 4 дні(-в)

4,9

(32 відгуки(-ів))

4,8

@harubel

Hello Sir, I am writing in response to your job. After carefully reviewing the experience requirements of the job description, I feel that I am a suitable match for the job. I’ve held several data entry positions that entail inputting customer requests, inquire, and tracking codes of products. I feel that I can add professionalism and accuracy to your current project. With extensive experience supporting all levels of a department and working directly with external vendors, I take direction well and can complete a heavy workload and complete projects under minimal supervision. If you feel there is a mutual interest, I would welcome the opportunity to meet with you to learn more about your company, the requirements of the position, and how my qualifications would be a good fit. I can finish this project as you wish from job description. Thank you in advance for your time and consideration. I look forward to Hiring from you soon. Cheers harubel

$555 AUD за 10 дні(-в)

5,0

(10 відгуки(-ів))

4,3

@meljux

Hi, I am an experienced web developer and software engineer. I have portfolio, over ten years of experience using MySQL and programming languages like python and ruby. If you are sure about the API to help scrapp your target data I can do it without any problem. Please drop me a line if you are interested in my services.

$750 AUD за 7 дні(-в)

5,0

(1 відгук)

2,8

@TechJSolutions

Dear Davidforbes64, I would like to work with you. I have experience using PHP CURL. Can you send the detail requirement and website link? Thanks

$560 AUD за 10 дні(-в)

5,0

(4 відгуки(-ів))

2,7

@bistanil98

I have check this requirement,have some query,so need to discuss this,please tell me how we can start the discussion. to know more about us please check Private Message. We have a team of professionals,they have more than 11 year of experience,so we can manage this work and will give you quality solution.

$700 AUD за 18 дні(-в)

1,9

(17 відгуки(-ів))

6,5

@apopavw

Hello! If provide me with the details, I could code a working demo for you to tinker with. Waiting to hear from you, AP

$666 AUD за 10 дні(-в)

5,0

(4 відгуки(-ів))

2,3

@mksoul

A proposal has not yet been provided

$555 AUD за 10 дні(-в)

0,0

(0 відгуки(-ів))

0,0

@wildpointer

I'm an experienced programmer with more than 6 years programming experience and 3 years MySQL experience. I know your requirements and I already have some ideas about it. Hoping to talk more details with you.

$444 AUD за 10 дні(-в)