Shiv A.
100% Job Success
Top Rated Plus

Solution Architect

Seeking for challenging task in design and development of scalable backend infrastructure solutions I work in following domains. 1. ETL Pipelines 2. Data Analysis 3. AWS (Amazon Web Services) and GCP (Google Cloud Development) deployment I mainly design all solutions in Python. I have 9 years of experience in Python. I have extensive experience in following frameworks/libraries - Flask, Django, Pandas, Numpy Regarding ETL Pipelines, I mainly provide end to end data pipelines using AWS/GCP/Custom Frameworks. I have more than 7+ years of experience in this domain. I have strong command in Scrapy and have done more than 300+ crawlers till date. Regarding Data Warehousing, I have extensive experience in Google BigQuery and AWS RedShift. I have hands on experience in handling millions of data and analyze them using GCP and AWS data warehousing solutions. I have 4+ years of experience in designing Serverless Applications using AWS and GCP. In addition to this, I am hands on bunch of services on GCP and AWS Cloud and provide efficient and cost effective solution over there.

Shiv A. has more jobs. Create an account to review them


  • ETL Pipeline
  • Scrapy
  • Python
  • Serverless Stack
  • Snowflake
  • AWS Glue
  • Generative AI
  • ChatGPT
  • PySpark


Endorsements from past clients

"I highly recommend Shiv Agrawal for web-scraping and we have been working with their team for over 5 years. The communication and response time is typically within minutes, and no longer than 1 hour. If we have issues, the team is available and our questions are always addressed. The work received is clear, detailed and functional. Of the many projects we have asked Shiv to complete, we have rarely had any instances where they could not complete the tasks. "

Michael K. | System Manager
Data Aggregator Feb 2020


"Our company and I have been working with Shiv for the last 4 years and we couldn't be happier. It is very hard to find reliable freelancers online but with Shiv we have been in great hands. 4 years ago we needed a freelancer to build an in house SQL data base that is connected to 30+ automated scrapers hosted on an AWS server in order to keep an eye on our competition. Shiv designed, built and still maintains the scrapers and database. He is extremely reliable and responds in a very timely matter. We are looking forward to continuing working with Shiv for many years to come. Any company will value his commitment and strong working ethics. Thank you Shiv! Bastian Green"

Bastian G. | Project Manager
Data Aggregator Feb 2020


"My go to guy for all scrapping needs. One time had to call him mid night for an urgent problem - no issue. Very impressive guy."

Pradyumna G. | Co-founder at AVOCADO
Feb 2020