scrape kickstarter for projects

Start from this page: [login to view URL] 1) record name and unique URL of every project on the page. (There are 20 campaigns per page). 2) For all 20 projects on the page, open campaign page: example: [login to view URL] navigate to 'comments' tab: example: [login to view URL] scrape and save first 5 comments navigate to 'campaign' tab: example: [login to view URL] Scrape and save: has_video: is there media present on page? (center underneath 'About This Project') ex: 1 name of campaign (center top of page') ex: HUB | The first Hi-Fi, Wi-Fi hub for headphones and speakers location of campaign (center underneath 'About This Project') ex: Sarasota, FL category of campaign (center underneath 'About This Project') ex: sound amount pledged and goal amount (center underneath 'About This Project') ex: $189,209, pledged of $100,000 goal scrape and save total number of rewards (right panel) ex: 13 free text boxes scrape and text from first reward (right panel) ex: // Pledge $5 or more94 backers THANK YOU! To show our appreciation of your support, we will provide you with regular updates and photos as we continue our [login to view URL] delivery:Apr 2017 // scrape and save funding period (bottom of right panel) ex: Mar 23 2016 - May 22 2016 (60 days) 3) go back to search landing page, open next page showing next 20 campaigns, repeat steps 1-2 example: [login to view URL] These results can be saved in a single sql table, with these columns: name_campaign comment_1_text comment_2_text comment_3_text comment_4_text comment_5_text has_video location_of_campaign category_of_campaign amount_pledged goal_amount first_reward_text number_of_rewards funding_period