Hire the Best Scrapy Developers
in China

I build modular Python data collection and ETL systems for public or authorized business data sources. I extract, normalize, validate, deduplicate, and enrich records from websites and APIs, then deliver reliable outputs to Google Sheets, CSV files, SQLite, or PostgreSQL. I completed a paid Upwork project covering five public data sources, a shared schema, multi-key deduplication, Google Sheets export, validation, tests, documentation, and source-code handoff. I can help with: • Python web scraping and multi-source data collection • Data extraction from websites and APIs, with CSV, Excel, or PDF processing when required • Data cleaning, normalization, validation, and deduplication • Google Sheets, CSV, Excel, SQLite, and PostgreSQL output • API data enrichment and scheduled ETL pipelines • Source tracking, error handling, tests, and documentation My typical workflow uses a separate adapter for each source, a shared normalized schema, deterministic validation rules, and quality checks before export. This keeps the pipeline maintainable and makes future sources easier to add. For new projects, I prefer starting with one representative source and a small paid milestone. We confirm access, required fields, output quality, and edge cases before expanding the full pipeline. Please include the target sources, required fields, sample output, update frequency, and preferred delivery format.

Anyone can scrape a page. The hard part — and what I do — is turning messy market data into something you can actually trade on: clean pipelines, point-in-time-correct databases, and bots that survive running 24/7. I build trading-adjacent data systems end to end: - Market data & pipelines — login-gated and JS-heavy sources, multi-source collection with failure isolation, normalized into Postgres/DuckDB - Point-in-time correctness — bitemporal databases with as-of replay and zero look-ahead leakage, so your backtests aren't lying to you - Signals & automation — rules-based market scanners, exchange API integration, Lightning/crypto automation, crash-resilient 24/7 deployment Recent work (real, with code & tests): - A bitemporal horse-racing trading database — Betfair historical pricing (600K+ price rows) + 280K+ race-card index, as-of replay validated leak-free, 176 passing tests (PostgreSQL/SQLAlchemy) - A Bitcoin (RoboSats) selling-automation system — 18-state order lifecycle, Lightning payments via Core Lightning, Tor routing, Docker API - A prediction-market arbitrage radar — scans 5,000+ live markets per cycle for YES/NO mispricing, DuckDB snapshots, 17 passing tests I care about correctness — bad data quietly ruins a trading system, so I build in reconciliation, idempotency and tests. Clear communication in English and Chinese. I'll tell you upfront if an edge isn't realistic rather than overpromising.

🟩 Overview I help businesses turn complex, login-protected websites into clean, structured datasets ready for analysis. I specialize in extracting reliable data from dynamic websites, including pages with anti-bot protection and heavy JavaScript rendering. Recently completed projects: Healthcare data project: extracted 11,000+ records from a login-protected platform Investment dataset: structured 17,000+ Crunchbase records into clean CSV format I focus on delivering accurate, structured, and ready-to-use data — not raw or incomplete outputs. 🟨 What I deliver Clean, structured data (CSV / Excel / JSON) Reliable extraction from dynamic and protected websites Handling of login, pagination, and complex page structures Fast and consistent delivery (typically 24–48 hours depending on complexity) Scripts may be delivered depending on project requirements. 🟧 Tools & Technologies Python (Scrapy, Playwright, Requests, BeautifulSoup) Dynamic websites (JavaScript / React / Vue-based pages) Data extraction and cleaning workflows Automation for repetitive data collection tasks 🟦 Sample & Process I can provide a free sample (5–10 rows) within 12 hours after reviewing the target website, so you can evaluate the data quality before starting the full project. 🟩 Why me ✔ 100% Job Success Score ✔ Experience with complex and dynamic websites ✔ Structured, analysis-ready datasets (not raw scraping output) ✔ Fast and reliable communication ✔ Focus on accuracy and long-term usability 🟥 Next step Send me your website — I’ll quickly check feasibility and provide a sample before we start.

Data & AI Solutions Engineer | Lead Generation & Web Data I build data pipelines and AI-powered tools that turn messy public web data into clean, decision-ready assets — and when it makes sense, into RAG-powered agents that answer questions from that data. What I solve: • Lead Generation at Scale — prospect databases with verified contacts (names, emails, phones, LinkedIn), enriched and deduplicated, ready for your sales team. • Market & Competitive Intelligence — pricing monitoring, product catalogs, review mining, market research. • Document Intelligence — parsing complex PDFs (tables, formulas, mixed-language) into structured Excel/CSV, and into chunked, embeddable formats for RAG. • AI Agents & RAG Pipelines — knowledge-base Q&A agents (WhatsApp, web, internal tools) on vector databases; document ingestion → chunking → embeddings → retrieval → LLM answer, with moderation and audit layers. • Anti-Bot & Hard Targets — Cloudflare, AWS-WAF, aggressive rate limiting: I know when to engineer around it and when to tell you it's not worth it. How I work: • Feasibility-first: I tell you what's realistic before you commit — including when the answer is "don't do this." • Accuracy over volume: every record is verified or clearly flagged. No fabricated data, ever. • Documented & reusable: scripts, schemas, pipelines you can run again without me. • AI done right: generated content is moderated and human-reviewed — I don't ship hallucination-prone outputs. Selected outcomes: • Built a 50,000+ record physician directory from publicly available health registries, deduplicated and URL-verified — delivered as a structured database for client's internal use. • Processed 60,000+ facility records (clinics, hospitals, labs) from an open government registry, with ~85% phone and ~75% email completeness — cleaned, normalized, and export-ready. • Extracted 15,000+ product reviews from a Cloudflare-protected e-commerce site in 3 days with dual-pass validation. • Delivered a 5,000+ record Google Maps enrichment pipeline (phone/website/email matching, 23-28% verified-match rate). • Processed formula-heavy, bilingual PDFs into structured Excel — eliminating days of manual re-entry. Skills: lead generation, prospect list, B2B data, list building, contact enrichment, data scraping, web scraping, Python, Playwright, Selenium, API integration, RAG, vector databases, PDF parsing, data cleaning, data mining, market research Languages: Fluent English & Chinese. Message me with your use case. I'll reply within 24 hours with a feasibility assessment and a realistic plan — including what I can't do, so you never waste budget on false promises.

I help e-commerce stores, businesses, and operators turn manual, time-consuming data tasks into fast, reliable, and error-free automated workflows. Whether you need to extract thousands of product listings from supplier websites, batch-download and rename image assets for auction/e-commerce catalogs, or sync messy data across platforms, I deliver clean, structured results. How I can help your business: • E-Commerce Data Extraction & Web Scraping: Extract product details, prices, specs, and variants from any protected or dynamic website using Python (Playwright/Scrapy/Selenium), Bright Data, or custom automated scrapers. • Catalog Preparation & Asset Processing: Format and map bulk inventory directly into target marketplace templates (eBay, LiveAuctioneers, Shopify, Zoro, Amazon). Automatically batch-download, organize, and rename thousands of high-res images to exact file-naming conventions in minutes. • Data Cleaning & Automated Formatting: Transform messy, inconsistent raw exports, PDFs, and spreadsheets into clean, structured CSV/Excel files with automated quality control checks to ensure zero missing fields or formatting errors. • Workflow Automation & API Integrations: Connect data across Google Sheets, Airtable, CRM systems, and e-commerce backends so your repetitive tasks run automatically. Why work with me: • Fast & Accurate Turnaround: Focused on 100% data integrity with no errors. • Simple Handoff: I deliver clean end-results (ready-to-use CSVs/organized assets) or lightweight automated scripts that you can easily run with one click. • Responsive & Clear Communication. Send over your target website, sample CSV/spreadsheet, or workflow description—let's make your data workflow fast and effortless.

I am Seemab - a detail-oriented AI Research Engineer who utilizes the power of AI to solve complex problems. I specialize in developing efficient custom AI, Data, and software solutions. With a strong foundation in Python programming, I excel at playing with AI models and evaluating them for specific use cases. Proven experience in cloud technologies like Server-less computation, Linux Servers, and databases. Skills: AI/ML Model, Python Engineer, N8N Workflows, Automation, Data Mining Projects: OCR WebApp Snowflake warehouse remodeling. Education: BS in Computer Science