Project objective: Develop Mozenda agents to scrape around 800 websites from around the world for news, press releases, regulation updates etc.
Team preference: Freelancer with team members to work on this OR 2 or more separate freelancers
- Planning with project lead, to fully specify work and websites
- Develop and test agents for the first ~200 top priority websites
- Review, amend if required
- Develop and test agents for remaining ~600 websites
We're looking to pay a piece rate per scraping agent - on applying please quote a fixed price for writing a single script and we'll set milestones around this.
Potential Milestones (if 2 people working concurrently):
* 2-3 weeks: agents for first ~200 websites complete, reviewed and signed-off
*6-9 weeks: agents for remaining ~600 websites complete, reviewed and signed-off
We're keen for work to start soon, let us know your availability to start. Note that we have future data mining projects and hope successful freelancers can work on those too.
- Have used Mozenda before to create website scraping agents
- Preferably including some knowledge of:
- how to use Xpath the streamline agents
- and using ‘data lists’ to separate scraping steps
September 6, 2018
I am looking for a mix of experience and value