Automated Website Data Script For ("Website Scrape")
Looking to get a quote for a software bot script that opens, collects into a list a set of data to assist in data mining project.
You will be responsible for identifying program language and writing the script that identifies and scrapes contact names, addresses, phone numbers, and email addresses.
We will provide the website name on PM.
• Automated Website Data Script For ("Website Scrape")
• Data mining and extraction into Excel File
Step A - scraping URLs: Following the administrator action providing with a domain URL (e.g. www.website.com, the software will scrape the website and will create a excel file.
Step B – scanning URL’s: Following the user click of a button, the solution will open those urls in the browser, and will replace the url with the next url from the list (created in step A), one page after the other, with a defined set timeout (example, after 30 minutes the script stops)
1. It is an installed software – installation need to be simple
2. The browser that will be open is chrome/android.
3. The defined timeout (session) to keep the URL page open before changing to the next URL from the list, can be customized by the administrator (e.g. 60sec, 95sec etc)
4. If the browser freeze or shutdown, the software open it again, and continue from the place it has failed. If that happens again, the URL is deleted from the list.
5. The administrator can replace the excel file (i.e. can have old list created, and have that scanned)
6. I am sensitive to the price, I don't care about the look and feel only the function..