Find Jobs
Hire Freelancers

connect scrapinghub scrapers to a mysql database and avoid duplicates

€30-250 EUR

Завершено
Опублікований over 4 years ago

€30-250 EUR

Оплачується при отриманні
I need someone to teach me and deliver me some code to write data to a mysql database and check for duplicates in order to avoid scraping twice the same item.
ID проекту: 21931994

Про проект

23 пропозицій(-ї)
Дистанційний проект
Активність 4 yrs ago

Хочете заробити?

Переваги подання заявок на Freelancer

Вкажіть свій бюджет та терміни
Отримайте гроші за свою роботу
Опишіть свою пропозицію
Реєстрація та подання заявок у проекти є безкоштовними
Доручений:
Аватарка користувача
Hey, I'll try to be brief: - For storing data to MySQL we need to create a pipeline which will have important method process_item() in which we will generate a SQL to add item to database - For preventing duplicates we have couple options A: Add unique identifier for item in to Database schema which prevents duplicates. We add all items and then catch MySQL error if it fails.  B: Before adding items to database we pull all unique identifiers from MySQL and filter out items that already in the list. C: - Let's figure out together :) Message me and lets talk more. Best regards, Povilas Kudriavcevas
€170 EUR за 3 дні(-в)
5,0 (23 відгуки(-ів))
5,4
5,4
23 фрілансерів(-и) готові виконати цю роботу у середньому за €131 EUR
Аватарка користувача
Hi there, This is Lin and I am scraping expert, i have checked all details for your project. can we discuss more info then i can provide example data for you? Please message me then we can discuss more ASAP. Thanks, Lin
€136 EUR за 3 дні(-в)
5,0 (377 відгуки(-ів))
7,9
7,9
Аватарка користувача
Hello sir I have 9 years of experience about python, scrapy and mysql. I can make a tutorial crawler to store data into mysql by avoiding the duplicates in a day. I can start the work right now. Best Regards, Yongtao
€155 EUR за 3 дні(-в)
4,9 (127 відгуки(-ів))
7,7
7,7
Аватарка користувача
Hi. I did read the project description and have a few questions. 1. Do you need the script as well or data only? 2. What is the format of the output data? CSV is OK? We can do other formats as well. 3. Which fields do you want to extract from the website? 4. How many results/urls are there? 5. What is the website? Let's get in touch and we can provide a sample. Thx, waiting for these details and hope to collaborate.
€125 EUR за 5 дні(-в)
5,0 (143 відгуки(-ів))
7,7
7,7
Аватарка користувача
I have good knowledge of PHP with Web scraping (CURL). I able to do this task very well with good quality. My main motto is client satisfaction and makes a long-term relationship with you. Thank you
€100 EUR за 1 день
5,0 (108 відгуки(-ів))
7,2
7,2
Аватарка користувача
Hello I have carefully studied the description of your project connect scrapinghub scrapers to a mysql database and avoid duplicates. I have deep expertise and hands on experience of 5 years with MySQL, Python, Scrapy, Web Scraping I enjoy brilliant ideas of my clients and I love working for them and be proud of having my hand behind their completed projects. I would like to know the more detailed about your project work to create the Project timeline and cost estimation. Kindly just click on the CHAT button and let's talk more about your project. I ensure a quick response to any inquiries and can provide an incredibly massive resource of information and ideas to make your vision come to life. OUR STRENGTHS + Regular Communication + Regular Work Update Report + Technology/Process Maturity I always put customer service first making sure you get what you want. FEEDBACK FROM MY CLIENTS: "Dipam is amazing Freelance Expert. It was my first time using this service and his work ethic, communication, and flexibility were perfect. I would recommend this team to anyone looking to complete a project, large or small in nature." "After over 200 hired on Freelancer- Dipam is hands down the absolute best Freelance Expert we have EVER hired! A true professional who is passionate and loves what he does." These are some of the testimonials prove that I can deliver the product with great quality on time and with zero worries. For me, client satisfaction comes first. ADDITIONAL BENEFITS - Extensive Quality Check & Testing. - Documentation and Suggestions for improvements. - Support and Maintenance with quick turnaround time. I assure that you would be happy to choose me as our mission is to build the long-term relationship. I am just a click away to help you. Just click on “CHAT” button and I am here right away to talk with you in detail..
€110 EUR за 4 дні(-в)
5,0 (14 відгуки(-ів))
6,1
6,1
Аватарка користувача
Hi there, I see you are looking for someone to provide you code for scraping without duplicates in mysql db. I am very much interested in the project.I have built scrapping script in the past. Please initiate chat so we can discuss further. Kind Regards, Robin
€250 EUR за 7 дні(-в)
5,0 (17 відгуки(-ів))
6,0
6,0
Аватарка користувача
*** Hello. I have good experience with MYSQL and SQL query. I understood your points. I can do your project well and asap. I want to discuss with you.
€100 EUR за 7 дні(-в)
4,9 (41 відгуки(-ів))
5,9
5,9
Аватарка користувача
hi , do you want desktop application that can you result and you want to delete them or you want to learn query thanks regards tscreators
€100 EUR за 7 дні(-в)
5,0 (21 відгуки(-ів))
5,3
5,3
Аватарка користувача
Hello! I am a developer with very long experience and very great experience. There is knowledge in various technologies. I studied the task of your project and I will say that I am ready to fulfill it and I know how. I’m happy to get to work right now. I want to work and I like to work. Waiting for your reply in the chat. Regards Anton
€140 EUR за 7 дні(-в)
5,0 (9 відгуки(-ів))
4,0
4,0
Аватарка користувача
Hello, I am pleasure with your job for connect scrapinghub scrapers to a mysql database and avoid duplicates. Thank you for the job posting. It’s a pleasure to meet you. I’d really like to work with you on this one if possible! I do have a couple of questions, but first I’d like to make you an offer and some background so you can check my work out. I have been developing kind of project within 10+ years so I’m fluent experience to handle project. You’ll get all the expected stuff like a great professional service and a fast turnaround, at a bit less, and I get a bit more exposure. If the above offer sounds like something you would be interested in, I’d love to hear from you. Best regards, Wang Yong
€140 EUR за 7 дні(-в)
5,0 (3 відгуки(-ів))
3,6
3,6
Аватарка користувача
Hello How are you? I've read carefully your job description. I have more than seven years experience in Development. Your satisfaction with the project is my top priority! If you give me a chance to work with you, then I will try my best level for your project to run successfully. Best Regards Ming
€140 EUR за 7 дні(-в)
4,9 (7 відгуки(-ів))
3,9
3,9
Аватарка користувача
*****_ Hello Sylvain C. _***** How are you ? https://www.freelancer.com/u/mihail99999?w=f I have read your detail very carefully and understood what you want. Your project is very easy and i think that your problem is only combine me. I am sure and i can complete your project in very short time. I will not say about my skill, only time prove me. On your detail, i have some questions. It is very necessary to complete your project perfectly. Let's discuss about your project via chatting. I will wait your response. Best regards. Thanks. From Mihail....
€120 EUR за 2 дні(-в)
5,0 (3 відгуки(-ів))
2,4
2,4
Аватарка користувача
I am a python developer with 3 year experience. I make a point to write my code in a consistent style adhering to the PEP8 style document. Reply me as soon as possible so we can discuss further details. Thank you!
€140 EUR за 7 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
We are new on freelancer but we have well-experienced team who have more than 4 years of experience. Give us an opportunity so that we can work with you. Let me know a good time when we can discuss it in detail and when we can start. Thanks & Regards V2infotech
€140 EUR за 7 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
Greetings, I am a backend developer and have written over hundreds of web scrapers and I would consider myself an expert in setting up pipelines, these pipelines would help you keep your database nice and clean without any discrepancies. Any new web scrapers you incorporate into your project, these pipelines will easily pick them up and you won't need to jump through any extra hoops to setup new scrapers. I'll be able to deliver this in 3 days. Hope to see us working together.
€140 EUR за 3 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0

Про клієнта

Прапор FRANCE
Paris, France
5,0
11
Спосіб оплати верифіковано
На сайті з бер. 14, 2016

Верифікація клієнта

Дякуємо! Ми надіслали на вашу електронну пошту посилання для отримання безкоштовного кредиту.
Під час надсилання електронного листа сталася помилка. Будь ласка, спробуйте ще раз.
Зареєстрованих користувачів Загальна кількість опублікованих робіт
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Завантажуємо для перегляду
Дозвіл на визначення геолокації надано.
Ваш сеанс входу закінчився, і сеанс було закрито. Будь ласка, увійдіть знову.