I need a freelancer to develop a web crawler that scrapes data off the VRBO for specific geographic markets and stores listing data and calendar availability in an Excel format.
... Scraper must be able to meter itself to avoid getting refused by the website for too many requests to the server. I don't want my IP to get blocked!
A. Crawler to crawl VRBO.com to identify all geographic destinations on the site
B. ... Publish: Inventory statistics by market
1. Inventory Pull function
-- Crawler goes to VRBO and scrapes all data about all properties for the user selected geographies
--Examples of data for each listing includes:
----We need to track multiple levels (parents and children) of geographies (e.g., Hawaii -> Maui -> South -> Kihei)
----Description: Name of Property (e.g., Grand Champion), Listing Identification Number, Listing Name
----Property Type: Condo, House, 1 bedroom, 1,442 Sq. ft., etc.;
----Unit Number (for Condos; e.g., Grand Champion Unit #75)
----Number of bedrooms, number of bathrooms, how many people it sleeps
----Size of home
----Min Stay Requirements
----Low season cost per night, high season cost per night, low season cost per week, high season cost pet week, holiday cost per night, holiday cost per week, etc.