We need to build a screen scraping engine in .NET v4.5 to be a base core for screen scraping multiple websites which sells Travel products like Flights and other.
The engine is to be provided as a library (DLL) and has API calls, from the other end it is extendable to add multiple websites to be screen scrapped in the future, each has its own rules for the markup.
One important feature is that the screen scraping should be done in parallel for multiple destination websites.
The engine should maintain the web-session, allow for multiple operations on the same target website with the same session, also it should support user-login to destination website.
Scenarios of operations on destination website:
- Search for a Travel Product (Take parameters of the search from the caller, get the price back and other information from the webpage), there could be multiple results (multiple Flights)
- Book one of the Flights returned in the previous step (take the selected flight from the caller and select the exact flight, call the book action, return success or failure).
Later we will build a web-service above the engine.
Deliverables are expected to be a complete source code of the engine in C#.NET 4.5, with an add on for one (1) destination website which will be told later.
To be elected for the job, applicant is expected to have strong web fundamentals knowledge in addition to great C# background.
More information to be provided by asking. And your questions are very welcome and essential to us before hiring, this will give us an indication of how well you read the description above and your understanding of it.