Python web scraper using ec2 and S3. Files rewritten by a text rewriter api.

Виконано Опубліковано %project.relative_time Оплачується при отриманні
Виконано Оплачується при отриманні

Create a python scraper that scrapes web pages, stores scraped files on S3 as text. The files are then rewritten by a rewriter api tool.

key steps are:

- Scrape links based on keywords, dates and number of requested articles from specfic websites

- Create the a source list of urls on a text file from this

- From this source list of urls on the text file extract the text contents of the web pages and output in text format

- Write these source articles to an S3 bucket folder

Once all article are retrieved

- run article through an text rewriter api

- place rewritten articles into a different S3 bucket and folder.

The article text file will have in its content

* The article url

* content of the article

The rewritten article text file will have just

* rewritten content of the article

The format of rewriting article should be

s3/folder/[login to view URL]

eg. s3/20230912/[login to view URL]

Required implementation tools:

Use a scraping api such as [login to view URL] to act as a proxy to grab links and articles.

Use an article paraphrase api such as [login to view URL] to rewrite articles.

These have free trial or low cost options for development

You need expertise in:

Python

EC2

S3

IAM

Linux

You will use your AWS account for development

On conclusion of the project you will supply:

1. Python code for the solution

2. Documentation describing how to implement the solution

3. Demonstration of code working

4. Assist with any implementation issues

Python Веб-скрапінг Amazon S3 Linux Amazon Web Services

ID Проекту: #37230224

Про проект

58 заявок(-ки) Дистанційний проект Остання активність 7 місяці(в) тому

Доручено:

serazummunirz

Hi There, I am capable of doing the above-mentioned job effectively and efficiently without any hassle. I have the required expertise and have worked on very similar projects in the past. I am confident that I am the Більше

£200 GBP за 1 день
(71 відгуків(-и))
6.1

58 фрілансерів(-и) готові виконати цю роботу у середньому за £170

chirgeo

Hi! I'm George, a web crawling expert with proven experience in scraping, rewriting and extracting data from web pages using Python, EC2 and S3. Having created a custom web scrapper myself, I'm confident that I can bu Більше

£408 GBP за 3 дні(-в)
(155 відгуків(и))
8.1
sonus21

Hello Obs! I hope you're well. I'm a senior Scraper developer with experience in developing scraper using scrappy and headless browsers. I can deal with bypassing IP throttling limit, ban and captcha solve, storing the Більше

£250 GBP за 14 дні(-в)
(55 відгуків(и))
6.2
anayapallavi

I can make web scrapper as per your requirement. Please initiate a message for further discussion.

£100 GBP за 4 дні(-в)
(17 відгуків(и))
5.3
QASIM7862001

I can make you a smart system which will perform the described task in 48 hrs Hey there, i am developer from the UK with over 9 years experience in web development. Upon reading your project description this seems lik Більше

£500 GBP за 1 день
(14 відгуків(и))
5.4
akhilvl1302

"Hi, I am an expert in Python, AWS and scraping. Can create features based on your requirement Skills: NodeJs, Python, PHP Please message me for further discussion. Thanks!"

£225 GBP за 7 дні(-в)
(74 відгуків(и))
5.8
prdraco

Feel free to contact me for Python web scraper using ec2 and S3. Files rewritten by a text rewriter api .shoot me message to discuss further more details .i provide the comments,images,videos,demos and live sessions i Більше

£150 GBP за 7 дні(-в)
(17 відгуків(и))
5.6
techplusintl

Hi there, ★★★ Scrapping / Python / Selenium Expert ★★★ 10+ Years of Experience ★★★ I've read requirements and ready to scrape web pages, stores scraped files on S3 as text. Some major works we do: ✔️ Product Websites Більше

£250 GBP за 2 дні(-в)
(32 відгуків(и))
6.1
carina0530

Hello, ✵✬✭✮ As senior scraper developer, I can complete your project perfectly!✵✬✭✮⚝ I have much experiences in EC2 field.(i have installed nodejs and python on ec2) I can get this done at short time, because i have a Більше

£135 GBP за 7 дні(-в)
(19 відгуків(и))
5.1
shrec

Dear, hello. I've rich 7+ years of experience in Python Web scraping and AWS, I have an AWS account, I just finished a job that was like that. I am certain that I can complete your project exactly as you require it b Більше

£135 GBP за 7 дні(-в)
(6 відгуків(и))
5.1
merinsinha

Python expert. I can do it. As 9+ years experiences in these field. I can give good quality work. I have read the guidelines of your work.I believe that i can provide you the best quality works you are anticipating fro Більше

£155 GBP за 3 дні(-в)
(54 відгуків(и))
5.6
Techalchemy

Hi Sir, As a highly skilled and experienced, I am confident that I can provide the high-quality work you need, but i have some doubts regarding the same, lets discuss in detail make it clear & then i am ready to start Більше

£135 GBP за 7 дні(-в)
(15 відгуків(и))
4.8
prateekhighskyit

I understand that you are looking for a Python web scraper that scrapes web pages, stores scraped files on S3 as text, and then rewrites the files using an article paraphrase API tool. I am confident that I can help y Більше

£135 GBP за 7 дні(-в)
(3 відгуків(и))
4.5
NadMax

Hi. Experienced Python Developer here with 8+ years of hands-on experience. I can assist you in creating a Python scraper for web pages, storing scraped files on S3, and implementing a text rewriting API. To proceed f Більше

£135 GBP за 7 дні(-в)
(3 відгуків(и))
4.7
dataspro

Nice to talk you Haktermast, After reading in detail the requirements of your project and concluding that they match my areas of knowledge and skills, I would like to introduce myself. My name is Anthony Muñoz and I Більше

£380 GBP за 7 дні(-в)
(4 відгуків(и))
4.1
AmazingEngr76386

I understand that you are looking for someone to create a Python web scraper that scrapes web pages, stores scraped files on S3 as text, and then rewrites these articles using an article paraphrase api tool. With my ex Більше

£200 GBP за 7 дні(-в)
(10 відгуків(и))
5.8
soramaru

Hello As a Python expert with 5 years of experience, I have mastered Python frameworks such as Django and Flask. I am familiar with building SaaS, booking, ecommerce, ERP/CRM, and backend(admin panel) using REST API. Більше

£120 GBP за 3 дні(-в)
(2 відгуків(и))
4.0
Dhawan8787

Hi sir. I'm excited about your project and confident in my ability to deliver your project . I'm committed to exceeding your expectations and ready to start from right away . Let's connect and discuss the next steps! T Більше

£135 GBP за 7 дні(-в)
(7 відгуків(и))
3.7
Demenntor

Dear Client, I am writing to express my interest in your project to create a Python web scraper that scrapes web pages, stores scraped files on Amazon S3, and utilizes a text rewriter API to rewrite articles. With my Більше

£220 GBP за 7 дні(-в)
(17 відгуків(и))
3.7
MohmedAbdelwahab

Hello there, I am mohamed and I am a highly experienced Python developer with extensive experience in machine learning, AWS, and data scraping technologies. With a deep understanding of Python programming, I have devel Більше

£135 GBP за 7 дні(-в)
(7 відгуків(и))
3.4
Rubi64420

Hello, I possess the skills and proficiency to perform the job mentioned above with ease and efficiency. I have the necessary expertise and a track record of successfully handling projects of a similar nature. I have Більше

£300 GBP за 4 дні(-в)
(2 відгуків(и))
3.1