Find Jobs
Hire Freelancers

Architect a Web Crawling Solution

€30-250 EUR

Закрито
Опублікований over 3 years ago

€30-250 EUR

Оплачується при отриманні
You must have at least 5 years experience in Web Crawling. You are very good at writing this in java and python. You have enough experience in Cloud (AWS). You know Relational as well as NoSQL Data bases. The web crawler is supposed to ; 1. Consider and observe the rules stated [login to view URL] of the crawled websites. 2. The crowler is scalable. Can be simultaneously run on many sites 3. The crawler is highly configurable . For example the crawler can : A) search websites based on a search words like handbags, or summer dresses B) or crawl for handbags in websites that have .de ending 4. The crawler gets images and text from websites for example image of a handbag its price, description, etc.. 5. The crawler sends the results to cloud for storage. The crawled text and meta data is also saved in cloud. 6. Each Image crawled and stored is indexed. Repeated crawl of the same site knows that a particular image is already been stored 7. Some more Requirements may get added to the list later.
ID проекту: 26962608

Про проект

11 пропозицій(-ї)
Дистанційний проект
Активність 4 yrs ago

Хочете заробити?

Переваги подання заявок на Freelancer

Вкажіть свій бюджет та терміни
Отримайте гроші за свою роботу
Опишіть свою пропозицію
Реєстрація та подання заявок у проекти є безкоштовними
11 фрілансерів(-и) готові виконати цю роботу у середньому за €300 EUR
Аватарка користувача
Dear Sir, I have gone through your requirements, I have 6+ years of experience in web scraping using java jsoup and selenium, I also have good experience in enterprise level web development. I'm perfect in planning of project architecture, as I have completed 100+ small and large projects in scraping, java and angular using mysql or mongodb. Expertise in Core Java, J2ee, Javafx, Spring boot, websocket, JPA, Hibernate, Angular, web scraping, web automation, mysql, mongo, postgreSql. Please ping me we can start your project immediately. Thanks & Regards
€225 EUR за 7 дні(-в)
4,9 (103 відгуки(-ів))
7,4
7,4
Аватарка користувача
Hi, Greetings! ✅checked your project details: Architect a Web Crawling Solution ✅Completed Time: In project deadline We have worked on 650 + Projects. I have 6 + years of the experience in same kind of projects. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 I would really like to work with you on this project. If interested, Kindly contact me via chat for further details and discussion.. Thank you Sandeep Digital screencast
€220 EUR за 4 дні(-в)
4,9 (145 відгуки(-ів))
7,3
7,3
Аватарка користувача
If you are looking for trusted freelancer who can complete the project after accepting it, then you can give us one chance to prove it to you. Check the below Skills. Artificial Intelligence Services : ------------------------------------------------- Modules - Sklearn,Numpy,Pandas, Matplotlib, Opencv, Keras , Tensorflow, Pytorch, Cafee Languages - Python, C++, Matlab => Data Science - Data Munging / Preprocessing, Feature Selection, Data Analysis, Model Building, Model Optimization, Model Deployment => Machine Learning / Deep Learning - SVM,Random Forest, Decision tree , XGBoost, Genetic Algorithm, Neural Network. Architechture - ANN, RNN,GRU,LSTM,BiLSTM,Encoder-Decoder,GAN, Q-Learning (Reinforcement Learning) => Computer Vision - Custom Object Detection, Pose Estimation , Age - Gender Prediction, Style Transfer, GAN In-Painting, Custom OpenCV Detection Models. Computer Vision Architechture - CNN,RCNN, Fast RCNN , FASTER RCNN, Mask-RCNN , YOLOv1, YOLOv3, ResNet, MobileNet much more. Thanks for taking time to read our profile. You can let us know what are planning to develop. We can help you acheive the target.
€250 EUR за 30 дні(-в)
4,8 (47 відгуки(-ів))
6,3
6,3
Аватарка користувача
Hello. How are you? I have been working with python scraping projects for many years. I read your description carefully and understand your requirements fully. The nice and familiar interface will greatly make you happy and I hope a long-term relationship with you Best Regards.
€100 EUR за 1 день
4,2 (2 відгуки(-ів))
2,0
2,0
Аватарка користувача
Hi I checked your post with title "Architect a Web Crawling Solution ". I am familiar to python. I want to discuss your project in detail. please contact me Thank you
€120 EUR за 3 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
Hi. Web Crawling expert here. I just read your job posting carefully and understand what you want. Let's have a talk for more detail. Looking forward to hearing from you. Thanks. Victor.
€1 500 EUR за 15 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
I am writing in response to your recent advertisement for the Solutions Architect position. With my extensive knowledge of multiple platforms and operating systems along with a creative mind focused toward innovation my qualifications make me an exceptional candidate for the role. My current Solutions Architect position has afforded me the opportunity to organize and develop the entire solutions process from start to finish. Excellent communication skills allows me the ability to serve as a liaison between Enterprise Architects and Applications Developers allowing the delivery of exceptional applications that work across a variety of platforms and systems. With a certification in AMAZON WEB SERVICES and 2 years of progressively responsible Solutions Architect experience my extensive knowledge can offer the visionary and innovative approach needed in the role. I have expert-level abilities in all operating systems platforms and functional analysis methods. My visionary skill translates into a big-picture solutions approach. I have strong strengths in conceptualization and implementation of applications development within the architectural structure. I know I am the best candidate for the Solutions Architect position and I believe upon meeting me you will agree. I can be contacted either via phone or email. I look forward to speaking with you. Sincerely, Mohammed abuzar bangar
€200 EUR за 7 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
About Me : Hi , My name is MHEDHEBI ISSAM , I am Python C++ Data Ming expert , i have moe then 3years experience in data mining including working in real companies of data mining and AI , i master scrapy , requests , bs4 , selenium , gevent , pandas , numpy , matplotlib , PyQt4 , Rotating proxies and user-agents , make scripts for automated logging and online search actions . Technologies : i have a library called Mono-spider , it rotate proxies and detect ban and it rotate user-agents , i had used in scrapping more then 50 website , it download proxies from internet , so no need to provide proxies . Best Projects : I have a google search scrapper behind proxies , i build it using my library . About your prject : if you want i show in attached docs a project similar of your project , that scrap cars from 14 website 24 h / 24 h and put the data in database .
€140 EUR за 7 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0

Про клієнта

Прапор GERMANY
wiesbaden, Germany
5,0
7
Спосіб оплати верифіковано
На сайті з лют. 25, 2019

Верифікація клієнта

Дякуємо! Ми надіслали на вашу електронну пошту посилання для отримання безкоштовного кредиту.
Під час надсилання електронного листа сталася помилка. Будь ласка, спробуйте ще раз.
Зареєстрованих користувачів Загальна кількість опублікованих робіт
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Завантажуємо для перегляду
Дозвіл на визначення геолокації надано.
Ваш сеанс входу закінчився, і сеанс було закрито. Будь ласка, увійдіть знову.