Scrape data from real estate website

as discussed (urls "Detail-URL" and "List-URL" will be shared privately) Scrape contact data from a real estate website and submit a form for each contact. It's basically going through a list (URL should be flexible; example: "List-URL" ) , go to each profile detail page (example: "Detail-URL" ) and save the contact data in a list (MySQL-DB). Then submit a form for each broker, example: "Form-URL" Each broker has a contact form (always the same basic url with changing IDs): Profile example: [login to view URL] -> we save 11516137821 then use [login to view URL]{{HERE COMES THE ID}} For the values for this form we have three data sets (simple array) hard-coded to prevent the scraper from being blocked by the site. We want to scrape the contact info like - company - name: - tagline: - place: - phone no - website this data is taken from the list page: [login to view URL] profile page: [login to view URL] So we will have 3 scripts: 1st script: 1st going through the whole list saving names and profile in the database (scraping) -> this script already exists in Perl, but needs to be enhanced to prevent the scraping agent from being blocked. 2nd script: going through all ids in the database and scraping the associated profile pages (scraping) -> this script already exists in Perl, but needs to be enhanced to prevent the scraping agent from being blocked. 3rd script: visit the form page based on profile id and submits the form: this script also sets a status to the profile saved in the database and the date the form associated with this profile was submitted. -> second milestone Budget for this is not more than 100 USD. Although we have scripts 1 and 2 in Perl, we might also consider a complete "re-do" in PHP.