Build database to automatically import my ecommerce web scraped data.

I currently have a web scraping service that scrapes a competitors website. I only scrape 3 brands. The web scraper service can then put the file into Google Drive, FTP or email it. This CSV file has really good data but it does need cleaned up. Currently I clean up the data manually each time. I also change prices manually, and sometimes change the description slightly. What I would like is to have a database (maybe access?) that automatically imports the csv from google drive, then looks for changes.

I would like to set parameters in place that can do things like: If the product price is between $.02 to $50, then set the price to $.01 less.

I also would like to get reporting of new products, removed products, products with price changes, etc.

Then I would like this cleaned up date to automatically upload to my live ecommerce site, which is currently hosted by bigcommerce.

Навички: Програмування баз даних, MySQL, PHP, Архітектура ПЗ, Веб-скрапінг

Деталі: scrape emails from website, easy web scraping, scrape data from website to excel, how to do data scraping, web scraping tool, web scraping applications, massive web scraping, data scraping

Про роботодавця:
( 6 відгуки(-ів) ) Macedonia, United States

ID Проекту: #17542748

24 фрілансерів(-и) у середньому готові виконати цю роботу за $12/годину


Hi, I can create such tool that will track changes. However I suggest that you do it as a web-based page utilizing your server's database instead of Access. I can also make changes in your ecommerce to automatically up Більше

$12 USD / година
(311 відгуків(и))

Dear Employer, Greetings of the Day! Thanks for sharing your requirements with us. For your project scope, I would be really glad to let you know that you can hire from our team of skilled developers and datab Більше

$12 USD / година
(160 відгуків(и))

Hello, how are you? I'm a senior web developer and I have rich experience in database management. Database seed, CSV import and export, statistical report, cron job, background service on server etc are no problem fo Більше

$12 USD / година
(53 відгуків(и))

We are a team having experience over 10+ years in PHP and it's Framework and Mobile [login to view URL] we have already developed Ecommerce,MARKETPLACE,CRM,ERP,POS,HRMS etc. Ecommerce Multi vendor: [login to view URL] Більше

$12 USD / година
(84 відгуків(и))

Hi there, It can be done and we can make it an automated process where through a cron , on a particular time gap,we can update the data base of your big commerce site and it will get updated accordingly. we have done Більше

$13 USD / година
(63 відгуків(и))

Ready to work and import data to your eCommerce with scrapping . Please open Message box so that we discuss it in detail Expertise ================== - PHP - Cryptocurrency - Code Ignator - Magento - Laravel Більше

$13 USD / година
(76 відгуків(и))

Hi sir. Thank you for your job posting. As data mining expert, I am very glad to see your project. I have strong experience in web scrapping using python, php and c#. I have created several price compare webapp so Більше

$12 USD / година
(103 відгуків(и))

Hello, Myself having has 10 + years experience of web site development. Expert in Custom programming in php / Mysql / Jquery / Wordpress/ Joomla / OSC / Magento /OpenCart / Android / Mobile development / Responsive. Більше

$11 USD / година
(252 відгуків(и))

Hi I am very,very interested in your project My name is Shan Bin and I'm a Chinese developer. I have 6 years of web scraper development experience such this projects. And I have good skills with this program languag Більше

$12 USD / година
(122 відгуків(и))

Hi, Let us take this opportunity to thank you for posting this requirement which is to scrap the website. We are a dedicated team of developers, who believe in quality and on time delivery. Developers who are hig Більше

$15 USD / година
(25 відгуків(и))

Hi There, Thanks for posting this job. I have reviewed your detailed requirement and understand it. I am ready to start with your project. I am #Bigcommerce expert with 7+ years of experience. I have devel Більше

$10 USD / година
(14 відгуків(и))

Hello, I can help with you in your project Build database to automatically import ecommerce web scraped data. I have more than 5 years of experience in Database Programming, MySQL, PHP, Software Architecture, W Більше

$12 USD / година
(79 відгуків(и))

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, Більше

$12 USD / година
(52 відгуків(и))

Hi there! Thank you for looking at my candidature. Web Development Expert is here. Hi went through your description, my team is interested in your project and wish to apply for it. We are a dedicated team of d Більше

$12 USD / година
(24 відгуків(и))

I believe what you are looking for in this project is a spider with the ability to process scraped data efficiently. With this in mind, I suggest to use Scrapy - a Python spider. I'm currently working in a data mining Більше

$8 USD / година
(16 відгуків(и))

We are highly expertise and experienced to developed custom eCommerce website and CMS website using WordPress, Woo commerce, Big commerce and Shopify. Please talk to us, we will start work on it straight away.

$11 USD / година
(21 відгуків(и))

Hello! Hope you are doing great! Before going into the deep let me ask you some basic questions so that I can interact with our team and able to deliver you the best possible product. 1. What will be the payme Більше

$8 USD / година
(11 відгуків(и))

Hello There, I have gone through your requirement, I have understood your work. I have extreme experience in Web Scraping. Have done a lot of scraping using python. I scrapped data from many e-commerce websites Більше

$15 USD / година
(8 відгуків(и))

Hi, I have recently completed and live the ecommerce application. Which has following features: 1 user interface 2 home 3 products 4 about us 5 cart 6 search products catalogs Note: I can provide you secure, Більше

$12 USD / година
(5 відгуків(и))

HI, DEAR CLEINT, i hopping that you enjoy this technology , I am BHARATI B. a professional WEBSITE DEVELOPER AND WEBSITE DESIGNING EXPERT, i am responding to your recent for a “ Build database to automatically Більше

$12 USD / година
(7 відгуків(и))