You will get permitted web data via API or authorized access and deliver clean CSV/Excel
Project details
I build API-first, compliant web data collection pipelines. I ingest from public/official APIs or client-authorized sources, then clean, validate, and deliver the data as CSV/Excel/JSON or a small FastAPI endpoint. I follow site terms, robots.txt, and applicable laws, and I use headless browsers only when access is explicitly permitted.
Full description
WHAT I DELIVER
• API-first data ingestion from approved/public APIs or sources you own/manage
• Optional browser automation only with your written authorization and in line with terms/robots.txt
• Cleaning & validation: dedupe, type casting, normalization, missing-value handling
• Schemas & docs: data dictionary, runbook, and Postman collection
• Delivery: CSV/Excel/JSON, Google Sheets sync, or REST API (FastAPI)
• Scheduling & automation on AWS (EC2/Lambda) with basic monitoring and retries
TECHNOLOGIES
Python, Pandas, FastAPI, Playwright/Selenium (authorized use), Requests, BeautifulSoup (authorized use), PostgreSQL/MySQL, Redis, AWS (EC2, S3, Lambda), GitHub Actions
USE CASES
• Product/catalog aggregation from official APIs
• Authorized back-office automations for your own accounts
• Research datasets from open data portals
Full description
WHAT I DELIVER
• API-first data ingestion from approved/public APIs or sources you own/manage
• Optional browser automation only with your written authorization and in line with terms/robots.txt
• Cleaning & validation: dedupe, type casting, normalization, missing-value handling
• Schemas & docs: data dictionary, runbook, and Postman collection
• Delivery: CSV/Excel/JSON, Google Sheets sync, or REST API (FastAPI)
• Scheduling & automation on AWS (EC2/Lambda) with basic monitoring and retries
TECHNOLOGIES
Python, Pandas, FastAPI, Playwright/Selenium (authorized use), Requests, BeautifulSoup (authorized use), PostgreSQL/MySQL, Redis, AWS (EC2, S3, Lambda), GitHub Actions
USE CASES
• Product/catalog aggregation from official APIs
• Authorized back-office automations for your own accounts
• Research datasets from open data portals
Data Tool
PythonWhat's included
| Service Tiers |
Starter
$50
|
Standard
$100
|
Advanced
$150
|
|---|---|---|---|
| Delivery Time | 2 days | 4 days | 7 days |
Number of Revisions | 1 | 2 | 3 |
Frequently asked questions
About Yasin
Senior Full-Stack Software Developer | Java Spring Boot, React, AWS
Dhaka, Bangladesh - 2:56 am local time
I cover backend, frontend and cloud: database design, API architecture, responsive UI, SEO-friendly websites, and ChatGPT/OpenAI integrations, RAG and workflow automation. 5+ years across automotive, logistics, e-commerce and SaaS.
🔑 𝗛𝗜𝗚𝗛𝗟𝗜𝗚𝗛𝗧𝗦
- 𝗕𝗮𝗰𝗸𝗲𝗻𝗱 𝗝𝗮𝘃𝗮 / 𝗦𝗽𝗿𝗶𝗻𝗴 𝗕𝗼𝗼𝘁 – REST/GraphQL APIs, microservices, multi-tenant SaaS, security (OAuth2/JWT), audit logs, rate limiting.
- 𝗙𝗿𝗼𝗻𝘁𝗲𝗻𝗱 𝗥𝗲𝗮𝗰𝘁 / 𝗡𝗲𝘅𝘁.𝗷𝘀 – admin dashboards, data tables, charts, forms, PWA-ready UX, design systems.
- 𝗔𝗜 & 𝗔𝘂𝘁𝗼𝗺𝗮𝘁𝗶𝗼𝗻 – ChatGPT/OpenAI, RAG, document/invoice OCR, AI assistants and workflow bots.
- 𝗔𝗪𝗦 & 𝗗𝗲𝘃𝗢𝗽𝘀 – EC2, S3, RDS, Lambda, CloudFront, Route 53, Docker/Kubernetes, CI/CD, Nginx.
- 𝗗𝗮𝘁𝗮 & 𝗜𝗻𝘁𝗲𝗴𝗿𝗮𝘁𝗶𝗼𝗻𝘀 – MySQL, PostgreSQL, MongoDB, Redis, queues, ETL, web scraping, third-party APIs.
✅ 𝗪𝗛𝗔𝗧 𝗜 𝗗𝗢
- 𝗕𝗮𝗰𝗸𝗲𝗻𝗱 (𝗝𝗮𝘃𝗮 / 𝗦𝗽𝗿𝗶𝗻𝗴 𝗕𝗼𝗼𝘁) – design and build REST/GraphQL APIs, microservices, background jobs, multi-tenant SaaS features, role-based access, audit trails and performance-focused data models.
- 𝗙𝗿𝗼𝗻𝘁𝗲𝗻𝗱 (𝗥𝗲𝗮𝗰𝘁 / 𝗡𝗲𝘅𝘁.𝗷𝘀 / 𝗔𝗻𝗴𝘂𝗹𝗮𝗿) – high-performance dashboards, admin portals, CRM/ERP UIs, complex forms, validation, charts and tables.
- 𝗔𝗪𝗦 & 𝗗𝗲𝘃𝗢𝗽𝘀 – deploy and run apps on AWS (EC2, S3, RDS, Lambda, CloudFront, Route 53), Docker/Kubernetes, CI/CD (GitHub Actions/Jenkins), logging and monitoring.
- 𝗣𝘆𝘁𝗵𝗼𝗻 & 𝗔𝗜 (𝗟𝗟𝗠𝘀) – OpenAI & Google Gemini integrations (chat, embeddings, content generation), RAG search, vector DBs, FastAPI microservices, Pandas ETL, OCR pipelines, web data mining/scraping and automation.
- 𝗗𝗮𝘁𝗮 & 𝗠𝗲𝘀𝘀𝗮𝗴𝗶𝗻𝗴 – MySQL, PostgreSQL, MongoDB, Redis, queues/caching, analytics and export pipelines (CSV/Excel/BI tools).
📂 𝗦𝗘𝗟𝗘𝗖𝗧𝗘𝗗 𝗣𝗥𝗢𝗝𝗘𝗖𝗧𝗦
- 𝗩𝗲𝗵𝗶𝗰𝗹𝗲 𝗖𝗥𝗠 + 𝗜𝗻𝘃𝗲𝗻𝘁𝗼𝗿𝘆 (Spring Boot + React + AWS) – leads, offers, vehicle stock, AP/AR, reporting, multi-region hosting.
- 𝗜𝗻𝘃𝗼𝗶𝗰𝗲 & 𝗕𝗶𝗹𝗹𝗶𝗻𝗴 𝗣𝗹𝗮𝘁𝗳𝗼𝗿𝗺 (Spring Boot + Angular + PostgreSQL) – tax/GST rules, payments, CSV/PDF exports, detailed audit trails.
- 𝗘-𝗰𝗼𝗺𝗺𝗲𝗿𝗰𝗲 𝗺𝗶𝗰𝗿𝗼𝘀𝗲𝗿𝘃𝗶𝗰𝗲𝘀 (Docker + Spring Cloud) – catalog, orders, payments, notifications, reporting.
- 𝗥𝗲𝗮𝗹-𝘁𝗶𝗺𝗲 𝗯𝗶𝗱𝗱𝗶𝗻𝗴 / 𝗾𝘂𝗲𝘂𝗲 𝘀𝘆𝘀𝘁𝗲𝗺𝘀 (WebSocket + Redis) – sub-100ms updates with horizontal scaling and role-based access.
- 𝗢𝗖𝗥 + 𝗔𝗜 𝗽𝗶𝗽𝗲𝗹𝗶𝗻𝗲𝘀 (OpenAI / Gemini / Vision) – document parsing and data extraction for invoices, bills of lading and certificates.
- 𝗔𝘂𝘁𝗼𝗺𝗮𝘁𝗶𝗼𝗻 𝗯𝗼𝘁𝘀 (Facebook, WhatsApp, Email, Google Sheets) – lead capture, enrichment and back-office workflow automation.
🛠 𝗧𝗘𝗖𝗛 𝗦𝗧𝗔𝗖𝗞 / 𝗞𝗘𝗬𝗪𝗢𝗥𝗗𝗦
Java, Spring Boot 3, Spring Security, JPA/Hibernate, Maven, REST API, GraphQL, Microservices, OAuth2, JWT, WebSocket, React, Next.js, Angular, TypeScript, Tailwind, Ant Design, AWS (EC2, S3, RDS, Lambda, CloudFront, Route 53), Docker, Kubernetes, Nginx, GitHub Actions, Jenkins, JUnit, Mockito, Postman, Swagger/OpenAPI, MySQL, PostgreSQL, MongoDB, Redis, Firebase, Python, FastAPI, Pandas, Selenium, Playwright, BeautifulSoup, LangChain, RAG, Vector Databases (Pinecone/FAISS/Redis), AWS Bedrock, Google Gemini, OpenAI / ChatGPT, OCR, ETL, Web Scraping, Data Mining.
💡 𝗪𝗛𝗬 𝗖𝗟𝗜𝗘𝗡𝗧𝗦 𝗛𝗜𝗥𝗘 𝗠𝗘
- 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻 𝗳𝗼𝗰𝘂𝘀 – reliable code, clear APIs, security and deployments that actually work in real environments.
- 𝗦𝗽𝗲𝗲𝗱 & 𝗰𝗼𝗺𝗺𝘂𝗻𝗶𝗰𝗮𝘁𝗶𝗼𝗻 – rapid iterations, transparent updates, written specs and documented tasks.
- 𝗘𝗻𝗱-𝘁𝗼-𝗲𝗻𝗱 𝗼𝘄𝗻𝗲𝗿𝘀𝗵𝗶𝗽 – from requirements and architecture to build → test → deploy → support.
Available to start quickly. Share your requirements and I’ll propose a clear, time-boxed roadmap for your project.
Steps for completing your project
After purchasing the project, send requirements so Yasin can start the project.
Delivery time starts when Yasin receives requirements from you.
Yasin works on your project following the steps below.
Revisions may occur after the delivery date.
Getting Requirement
Share target URLs and fields you want.
I build a quick sample to validate structure.