I will make this description as detailed as possible.
*** Please ask any questions you have PRIOR to start of the job. ***
*** It should be noted that the code for the report generating is mostly redundant. ie: given a date range, it still calculates the same data each time. So the only bulk of the coding is in the efficiency of the scraping and the efficiency of the database design and coding. The remainder is adding / updating property information and displaying the data
*** Please see attachment as it details pseudo code, database ideas, and a mockup of what I would like the end result to look something like. ***
* The entire thing should be able to run on either a [login to view URL] or [login to view URL]
hosting plan.
* As such - the idea is to be able to configure the service, update as needed, and pull reports via a browser / via the cloud.
* A cron job will have be written and implemented to run the scraper daily without it being started manually by me.
* Use of a GUI front end to select reports and display results ( see attachment )
* Ability to download reports in either PDF or XLS format
The goal is this:
I run a small youth hostel. I want to watch other hostels to keep an eye on prices, availability, and other factors. This information can be scraped from one website.
I would like to be able to add new properties to watch in other cities if I were interested in maybe expanding into a different city.
So you see, I will need to be able to add new "products" to be scraped.
The scraping, ideally, would happen automatically every day for whichever properties I specify, however if not, I can run the script manually everyday.
As information is scraped, I want to be able to look at things such as:
average price for whatever date range I enter
how many beds were sold between dates
average occupancy
% of total beds sold
etc
After that, the scrape should occur everyday and the data can be compared
Please view the attachment as I put quite a bit of thought into both the pseudo code descriptor of the database design and of the functionality of the GUI / Reports.
Additionally I've pointed out what sections of the websites source code you may need.
Milestones will be as such:
1/4 of project price for working prototype ( add properties, automatic scrapes, data displayed in at least 2 reports properly )
1/4 of project once all reports are properly functioning, ability to download reports is operational, adding properties and marking as "active" or "inactive" is operational
1/2 of project once software is installed and proven to be operational on my own server ( this includes the database itself, the cron job for automatic scraping, GUI, and all above features etc )
Kindly ignore the bid amount & time-line, it is just a placeholder, as our estimate is higher than your set budget, so would you be flexible in it?
--------
Dear Sir,
I have read your Project Description and understand the high level requirements of your project. So, this initial message is just a formal confirmation that we are interested in this Project & technically there are no hurdles, as we have experienced team (40 + developers & few Designers) but your budget is very low as compare to the overall scope of work, so can you please increase it? If not then no problem and I totally understand.
Look forward to hearing from you and talking to you further thru' Freelancer message board.
Regards,
YK
LEADconcept
Hello,
I checked all of your attachement. I love scraping projects and this looks very very attractive. But the database design you suggest wouldn't work, so we need to create another way. For example:
hostel_data
hostel_price
hoste_data will hold static data, and hoste_price table will store price per day. So, calculation will be easier. Anyway, good luck on your project.
Thanks.
Dear Customer!
I am an expert PHP developer with over 6 years of experience and very interested to work on this project. Available to start immediately and finish as soon as possible. My bid is for fast professional service exciting my customers. Please contact in PMB to discuss details.
Best Regards,
Zeke
Hi,
i have good experience in scraping data from other site, in past i have scrape data from dating site making auto login, and also scape songs from songs sites, and daily deals detail as well, Lets starts!
Hi Rudolph,
I am highly experienced when it comes to Web scraping, and I develop scrapers in standalone (e.g., Java SE, Microsoft .NET) and Web-based (e.g., PHP) solutions. I see that you want to watch your competition, and that you want to have a scraper run via cron jobs. I am the man for the job. I guarantee you will be satisfied with my work
Do you already have a live website? If yes, are you looking into integrating the scraper with the website, or will the scraper be used just for your own consumption?
Respectfully yours,
Mark
I have done same kind of work lot of time.
I am Team Lead/Project Manager role in a company.
I have team of 10 developers and 2 designers.
We need more projects if any one can provide us.
We are scraping data from some portals and using that data to some other sites.
About Me:
I have 11+ years of web development experience.
Expertise : Web Scraping, Web Applications Development using ( PHP, MYSQL, CSS3, HTML5, JQuery, JavaScript, Bootstrap3, Yii Framework)
Hello Sir, I have more than 3 years experience in Php web developement as well as webscraping . After reading your requirements I think I can do your job properly within time.I am waiting for further response. Thank you
Hello, Having gone through your requirement; I feel suitable enough for the role hence my application for the project. I am happy to work with you on this project to achieve set objectives and targets.
Hello there, I am interested in taking on this project. I have read your documentation and would like to discuss this opportunity further with you. Kind regards, Daniel
Hi Dear Hiring Manager, I ensure to bring all your requirements successful in time and you will see the difference of my work. I always try to provide more then 100% quality work as established the long term relationship. Thank You, Yogesh Kumar.
Hi,
I am working on another scraping project so I have the right experience to help you to develop your idea.
I have a MD in Computer Sciences and more over 5+ experience in programming.
Web is my big passion.
I am sure I can contribute to this project and I hope you will consider me as the best freelance.
BR