You will get an easy to use scraper that extracts data you need from URLs you provide
Project details
You will get a thoroughly documented, easy to use scraper that will read the list of URLs or follow a set of instructions to crawl through every link that's of interest and output the data you require. This will be built in Python, and depending on your needs, could simulate requests (using Scrapy) or actually open an automated browser window to collect the data.
Data Tool
PythonWhat's included $250
These options are included with the project scope.
$250
- Delivery Time 10 days
- Number of Pages Mined/Scraped 10000
- Number of Sources Mined/Scraped 1
- Number of Revisions 3
Frequently asked questions
About Daniel
Get the most out of your data
Sao Paulo, Brazil - 4:20 pm local time
What I offer is experience in extracting real, tangible value from data using gold standard tooling (Python, SQL, etc.) to collect the data you need, structure it in the best way possible and find out what it can really provide in terms of immediate benefit to you.
From automating processes to web scraping to creating machine learning models to predict trends from your data, I've got the technical side covered - and if you need someone to present those findings, be it through beautiful intuitive visualizations or direct, no-nonsense presentations, I'm your guy.
Fluent in English and Portuguese. Dual citizen of the US and Brazil.
Some of the projects I've worked on:
- Universal recommendation system for E-Commerce Platform @ VTEX
This Neural Network based recommendation system allows VTEX client stores to offer relevant recommendations to their clients with no manual setup regardless of the segment they're in
- Largest and most complete startup database in LATAM @ Distrito
Thanks to my work automating data collection, cleaning and analysis, the innovation hub Distrito, in Brazil, now holds the largest wealth in startup data in LATAM, allowing it to predict trends and identify investment opportunities
- Automated dynamic pricing for short-term rentals @ Casai
Using a combination of several techniques and with proven efficacy through causal inference and controlled experiments, we have automated the pricing of our units at Casai to free up our Revenue team and maximize revenue efficiency for our 200+ units
- Letterboxd recommender system
A fine-tuned platform for generating recommendations for Letterboxd users. Received to much acclaim from real users, and used by dozens of people every day to generate recommendations. Available at letterboxd.tools
Steps for completing your project
After purchasing the project, send requirements so Daniel can start the project.
Delivery time starts when Daniel receives requirements from you.
Daniel works on your project following the steps below.
Revisions may occur after the delivery date.
Gather requirements
I'll need you to describe which site you want the scraper to be used on, how it should know which links to visit and exactly what information you need from each page.
Sample output
I'll examine the structure of the page, build the data collection pipeline for the scraper and confirm that the output I get is what you're looking for.