You will get Python Web Scraper/ Scrapy Crawler for any website.
You will get Python Web Scraper/ Scrapy Crawler for any website.
Project details
In this project, you will get a high-quality web scraper using Python and Scrapy. It will be scalable to scrape millions of items with concurrent requests and save them into the desired formats like CSV, JSON, XML and DB etc. I have over 3 years of experience building and deploying complex web scraping solutions for dynamically loaded websites. Some of the domains that I have scraped include:
- Ecommerce stores
- Restaurants and Hotels
- Job listings
- Real estate websites
- Any custom data extraction requirements
Data accuracy is the key to the success of any data-driven startup and I deliver high-quality data to perform desired data analytics.
- Ecommerce stores
- Restaurants and Hotels
- Job listings
- Real estate websites
- Any custom data extraction requirements
Data accuracy is the key to the success of any data-driven startup and I deliver high-quality data to perform desired data analytics.
Data Tool
ScrapyWhat's included
| Service Tiers |
Starter
$50
|
Standard
$150
|
Advanced
$250
|
|---|---|---|---|
| Delivery Time | 3 days | 5 days | 7 days |
Number of Pages Mined/Scraped | 5000 | 15000 | 30000 |
Number of Sources Mined/Scraped | 1 | 1 | 1 |
Number of Revisions | 3 | 5 | 7 |
Optional add-ons
You can add these on the next page.
Additional Page Mined/Scraped
(+ 2 Days)
+$50Frequently asked questions
10 reviews
(10)
(0)
(0)
(0)
(0)
JJ
Jon J.
Aug 5, 2022
Very good provider.
Excellent communication and product delivery
Excellent communication and product delivery
EK
Eric K.
Mar 18, 2025
Seeking Data Scientists with ETL, ML, Python experience / gsmlsmus-2025-q1
Mehar did a great job on ETL and ML tasks. We’d be happy to work with this freelancer again.
ES
Emily S.
Nov 27, 2023
Update Data Cleansing Python Script
Knowledgeable and helpful. Did great work creating data cleansing scripts.
PK
Paris K.
Aug 7, 2023
Seeking Data Scientists/Data Engineers with ETL, ML, Python and PySpark exp [Databricks-gsml-2023-1]
Mehar did a great job on ETL and ML tasks using Azure Databricks. We'd be happy to work with this freelancer again.
JT
James T.
Jun 22, 2023
Python Programmer Needed
Mehar was hired to build me a custom Python program to combine data from two csv files, perform some calculations and create a new csv file. He did a fantastic job and went above and beyond to get the job done correctly. I will be hiring him for projects in the future and can highly recommend him.
JF
James F.
May 18, 2023
Contract For Ongoing SQL Consulting
About Mehar
Sr. Data Engineer
100%
Job Success
Lahore, Pakistan - 5:52 am local time
Core Skills:
ETL and Data Engineering:
Python, SQL, Postgres, Snowflake Cloud, Apache Airflow, Apache Spark, Azure Databricks, AWS S3 Python SDK, AWS ECS, EC2, Database Development, Writing Complex SQL queries.
Web Scraping:
Python, Scrapy, Selenium, Bs4, Playwright, Regex
Scripts and Automation:
Excel file transformation using Python. Merging and cleaning different types of files like CSV, XML, Excel, JSON etc.
API Development:
Django, Flask, FastAPI, HTML, CSS, Consuming Open AI's APIs to work with Chat GPT and other LLMs
Steps for completing your project
After purchasing the project, send requirements so Mehar can start the project.
Delivery time starts when Mehar receives requirements from you.
Mehar works on your project following the steps below.
Revisions may occur after the delivery date.
Source Analysis
In this step, I will go through the provided source URL and analyse the website structure and look for: - Required data points - anti-bot/ blocking mechanism - Dynamically loaded or simple website
Start coding and Data Extraction
After analysing the website I will build the Scrapy spider and provide some sample data. Once you finalise the schema I will run the crawler for complete data extraction and output the data in the desired format.