• I use data from various websites for my work
• I have a program that was developed by a friend to automatically retrieve this data on a daily basis
• To date, this program has been useful but one of the websites I scrape from has changed the location (and maybe format) of some of its data so the program needs fixing
Description of Existing Program
• The autoscraper program runs on Windows 7 Home Premium
• The autoscraper program is written in Perl. The file is called autoscraper.pl
• The program uses Firefox version 19.0.2
• The program also uses the Firefox add on Mozrepl version 1.1.2
• There is a GUI that uses the GTK library
• The program outputs all data collected into preformatted excel spreadsheets
Background to the Change Requirements
• The program collects data from three sites. One of these is the OECD.
• Three types of data are collected from the OECD: 1. OECD BM data; 2. OECD IP data; and 3. OECD IR data.
All three OECD components...