You will get big data analysis and ETL pipeline
Project details
I will provide:
Data Manipulation,
ETL Pipelines in Pyspark/Hive,
Analysis of Data,
Machine Learning,
Pandas dataframes analysis.
Ready to take up large scale projects, can give ideation to development for projects.
Custom orders are also accepted. Please message me before placing order.
Data Manipulation,
ETL Pipelines in Pyspark/Hive,
Analysis of Data,
Machine Learning,
Pandas dataframes analysis.
Ready to take up large scale projects, can give ideation to development for projects.
Custom orders are also accepted. Please message me before placing order.
Data Tool
PythonWhat's included
| Service Tiers |
Starter
$150
|
Standard
$250
|
Advanced
$450
|
|---|---|---|---|
| Delivery Time | 1 day | 3 days | 7 days |
Number of Revisions | 1 | 2 | 2 |
About Harshit
Python | Django Developer | Web Scraping | Data Extraction
Basti, India - 12:37 pm local time
as a Programmer in one of the most reputed organizations of world.
My main skills are:
* Web development using Django, Django rest framework(API)
* Development of crawlers and spiders to navigate a website like a human.
* Code custom web scrapers and automation tools to extract data from different sources
such as social media websites, e-commerce, real estate, job boards.
* Experience in ✔️Pyspark, ✔️Spark SQL, ✔️Airflow, ✔️Hive, ✔️Python and have worked in corporate level on TBs of dataset.
* Reading of data from RESTfull API's, txt, CSV or excel.
* I can build outputs in CSV, Excel, txt, POST Request to your server or store in Databases like MongoDB.
* I take my time to analyze and design the best crawling strategy.
* I use proxy rotation and other methods for complex sites.
* I can easily bypass anti scraping solutions deployed on the website and can reverse engineer APIs to fetch the data
* Web scraping using ✔️Selenium Web Driver, ✔️Requests, ✔️bs4, ✔️REGEX, ✔️my own functions & scripts.
# My priority are quality and client satisfaction.
# My intent is to work on the projects which I can be proud of, so I'm looking forward to work with you. Feel free to contact.
Steps for completing your project
After purchasing the project, send requirements so Harshit can start the project.
Delivery time starts when Harshit receives requirements from you.
Harshit works on your project following the steps below.
Revisions may occur after the delivery date.
Requirement Gathering
We need as much as information possible regarding your requirement like What information you want to scrap and from which source. We talk and decide on the goals and outcomes of your project. Any modifications to data, if needed.
Development
Preparing scraper codes and running small tests on my side.