Anyone can scrape a page. The hard part — and what I do — is turning messy market data into something you can actually trade on: clean pipelines, point-in-time-correct databases, and bots that survive running 24/7.
I build trading-adjacent data systems end to end:
- Market data & pipelines — login-gated and JS-heavy sources, multi-source collection with failure isolation, normalized into Postgres/DuckDB
- Point-in-time correctness — bitemporal databases with as-of replay and zero look-ahead leakage, so your backtests aren't lying to you
- Signals & automation — rules-based market scanners, exchange API integration, Lightning/crypto automation, crash-resilient 24/7 deployment
Recent work (real, with code & tests):
- A bitemporal horse-racing trading database — Betfair historical pricing (600K+ price rows) + 280K+ race-card index, as-of replay validated leak-free, 176 passing tests (PostgreSQL/SQLAlchemy)
- A Bitcoin (RoboSats) selling-automation system — 18-state order lifecycle, Lightning payments via Core Lightning, Tor routing, Docker API
- A prediction-market arbitrage radar — scans 5,000+ live markets per cycle for YES/NO mispricing, DuckDB snapshots, 17 passing tests
I care about correctness — bad data quietly ruins a trading system, so I build in reconciliation, idempotency and tests. Clear communication in English and Chinese. I'll tell you upfront if an edge isn't realistic rather than overpromising.
Scrapy
Python
Web Scraping
Selenium
REST API
API Integration
Automation
Data Extraction
Browser Automation
pandas
Task Automation
ETL
Python Script
PostgreSQL
Data Engineering
Time Series Analysis
API Development
Financial Analysis
Bitcoin
SQL
Zhendong L.
Huizhou, China
$20/hr
5.0
6 jobs
🟩 Overview
I help businesses turn complex, login-protected websites into clean, structured datasets ready for analysis.
I specialize in extracting reliable data from dynamic websites, including pages with anti-bot protection and heavy JavaScript rendering.
Recently completed projects:
Healthcare data project: extracted 11,000+ records from a login-protected platform
Investment dataset: structured 17,000+ Crunchbase records into clean CSV format
I focus on delivering accurate, structured, and ready-to-use data — not raw or incomplete outputs.
🟨 What I deliver
Clean, structured data (CSV / Excel / JSON)
Reliable extraction from dynamic and protected websites
Handling of login, pagination, and complex page structures
Fast and consistent delivery (typically 24–48 hours depending on complexity)
Scripts may be delivered depending on project requirements.
🟧 Tools & Technologies
Python (Scrapy, Playwright, Requests, BeautifulSoup)
Dynamic websites (JavaScript / React / Vue-based pages)
Data extraction and cleaning workflows
Automation for repetitive data collection tasks
🟦 Sample & Process
I can provide a free sample (5–10 rows) within 12 hours after reviewing the target website, so you can evaluate the data quality before starting the full project.
🟩 Why me
✔ 100% Job Success Score
✔ Experience with complex and dynamic websites
✔ Structured, analysis-ready datasets (not raw scraping output)
✔ Fast and reliable communication
✔ Focus on accuracy and long-term usability
🟥 Next step
Send me your website — I’ll quickly check feasibility and provide a sample before we start.
Scrapy
Web Scraping
Python
Data Cleaning
pandas
Microsoft Excel
Automation
Data Processing
JSON
CSV
Data Mining
Selenium
Seemab Y.
Changsha, China
$15/hr
5.0
12 jobs
I am Seemab - a detail-oriented AI Research Engineer who utilizes the power of AI to solve complex problems.
I specialize in developing efficient custom AI, Data, and software solutions. With a strong foundation in Python programming, I excel at playing with AI models and evaluating them for specific use cases. Proven experience in cloud technologies like Server-less computation, Linux Servers, and databases.
Skills: AI/ML Model, Python Engineer, N8N Workflows, Automation, Data Mining
Projects:
OCR WebApp
Snowflake warehouse remodeling.
Education: BS in Computer Science
Scrapy
Python
Data Scraping
Selenium
Data Processing
Data Manipulation Language
Data Engineering
Automation
Data Extraction
ETL Pipeline
Spreadsheet Automation
Web Scraping
SQL
DevOps
pandas
Jackey C.
Fuzhou, China
$20/hr
5.0
2 jobs
Python web scraping specialist with a Master's degree in Computer Science and over 5 years of experience building reliable data extraction pipelines. I help businesses turn messy web data into clean, structured, usable information.
What I do:
• Scrape dynamic JavaScript-heavy websites (single-page apps, infinite scroll, lazy loading)
• Extract data from Cloudflare-protected and other anti-scraping platforms
• Parse complex PDF documents — including those with tables, formulas, images, and mixed Chinese-English content
• Build automated monitoring pipelines for competitor pricing, product listings, and market research
Recent project examples:
- Extracted 15,000+ product reviews from a Cloudflare-protected eCommerce site, handling API pagination limits with dual-pass crawling
- Built automated data extraction from directory websites (500+ records scraped and verified)
- Processed PDF documents containing mathematical formulas and mixed-language content into structured Excel output
I deliver:
- Clean CSV/Excel files with proper headers and units
- Well-documented, reusable scripts
- Regular progress updates so you always know where things stand
Fluent in both English and Chinese — I can handle projects that require either language.
Let me know your requirements and I'll provide a quick feasibility check before we start.
Data Extraction
Web Scraping
PDF Conversion
Image Processing
OCR Algorithm
Computer Vision
API Integration
Selenium
Automation
Audio Transcription
Yongjun M.
bei jing, China
$25/hr
4.9
27 jobs
I am a seasoned full-stack developer with a strong focus on AI-powered interactions—including AI chatbot development, conversational UX, and intelligent agent integration. I build products from 0 to 1 and quickly diagnose issues in existing systems to improve performance, user experience, and business impact. I deliver maintainable, scalable, and deployable software with end-to-end ownership.
Core Expertise (AI & Full-Stack)
AI & Intelligent Interactions – Design and implement AI chatbots, voice/text assistants, and natural language interfaces. Integrate LLMs (GPT, Claude, open-source models) with RAG, fine-tuning, and prompt engineering for domain-specific use cases. Build real-time conversation flows, context management, and fallback strategies that feel human and reliable.
End-to-End Product Delivery – From discovery and prototyping to deployment and monitoring. I own the full lifecycle, ensuring clean architecture, scalable systems, and predictable timelines.
Rapid MVP & Iterative Development – Turn ideas into working products quickly, then iterate based on data and user feedback.
Legacy System Stabilization & Refactoring – Improve performance, reduce technical debt, and modernize outdated codebases without disrupting business operations.
Frontend-Backend Synergy – Optimize API design, state management, and real-time data flows for seamless UX.
Data-Driven & AI-Enhanced Products – Implement analytics, recommendation engines, and AI capabilities that drive engagement and conversion.
Tech Stack
Frontend: HTML, CSS, JavaScript, TypeScript, TailwindCSS, React/Next.js, Vue/Nuxt.js, Angular
Backend: Python (Django, Flask, FastAPI, Scrapy, Scikit-learn), Node.js (Express, Nest.js)
Java: JSP, Spring Boot, Nacos, MicroService, JPA, MyBatis, MyBatis-Plus
C#: ASP.NET WebForms, ASP.NET MVC, Razor Pages, .NET Core, Entity Framework, Dapper, WinForms
PHP: Laravel
AI/LLM: LangChain, LlamaIndex, OpenAI API, Anthropic, Hugging Face, vector databases (Pinecone, Milvus, Weaviate), RAG pipelines, conversational memory, speech-to-text / TTS
Databases: MongoDB, MySQL, PostgreSQL, SQL Server, Firebase, SQLite
Cloud & DevOps: AWS EC2, Microsoft Azure, Docker
Collaboration: Git, SVN, Jira, Slack
Mobile: Flutter, Ionic, Capacitor, uni-app, Taro
How I Work
Clear communication, predictable delivery, and transparent progress. I provide daily updates, early risk detection, and flexible engagement—feature-based, milestone-based, or long-term partnerships. I treat your business goals as my own and ensure every line of code adds value.
Highlights
Projects: SaaS platforms, internal enterprise systems, data-driven web apps, and AI-powered chatbots/assistants for customer support, sales, and internal knowledge retrieval.
Accomplishments: Delivered MVPs under aggressive deadlines, stabilized legacy systems with 40%+ performance gains, and launched AI chatbots that reduced support tickets by 30% while improving user satisfaction.
If you need a full-stack developer who deeply understands AI interactions and can own delivery from concept to production—with uncompromising quality—let’s talk. I’m ready to build your next intelligent product.
Java
JavaScript
Python
Node.js
PHP
.NET Core
SQL
HTML
Flutter
Angular
Vue.js
CI/CD
DevOps
Full-Stack Development
Front-End Development
jiarong W.
Shanghai, China
$15/hr
5.0
5 jobs
An experienced full-stack developer and RPA engineer, specializing in creating robust, scalable systems and automating processes to enhance efficiency. With extensive expertise in Python, I’m skilled in libraries and frameworks such as FastAPI, Scrapy, Vue.js, Playwright, and SQLAlchemy. I also have a strong background in reverse engineering, webpack, and JS manipulation, allowing me to tackle complex problems and develop efficient, tailored solutions.
Key Skills & Areas of Expertise:
Full-stack Development: Designing and developing dynamic, user-friendly websites and applications using modern technologies.
Automation & RPA: Building automated systems to replace repetitive tasks and optimize workflows, utilizing Python, RPA frameworks, and Playwright.
Reverse Engineering: Expertise in analyzing and understanding systems or software to extract data, optimize performance, or customize functionality.
Data Science & Analysis: Handling data extraction, cleaning, and visualization with libraries like Pandas, SQLAlchemy, and others.
API Development: Creating efficient, high-performance APIs with FastAPI, managing asynchronous requests, and integrating with databases.
Thriving in high-pressure environments, I focus on solving intricate technical challenges and delivering high-quality results. Whether it's building sophisticated web apps, automating business processes, or reverse-engineering systems, I am committed to delivering impactful solutions.
Let’s collaborate and bring your ideas to life.
Scrapy
Data Mining
Mining
ETL
ETL Pipeline
Agriculture & Mining
Data Extraction
How it works
Post a job for freePost a job
Tell us what you need. Create your own job post or generate one with AI then filter talent matches.
Hire top talent fast
Consult, interview, and hire quickly, so you can meet the freelancers you're excited about.
Collaborate easily
Use Upwork to chat or video call, share files, and track project progress right from the app.
Payment simplified
Manage payments in one place with flexible billing options. Only pay for approved work, hourly or by milestone.
Don't just take our word for it
“Upwork provides an umbrella-level of security. I can see a talent’s work history and ratings. I can hold payments in escrow. I can communicate through Upwork Messages instead of working through my email address.”
KD
Kim Darling
Emerald Tiger
“Upwork is the best platform to hire skilled professionals when we're not looking for a full-time employee. All the companies in our portfolio use Upwork to find talent across a wide range of fields.”
DM
David Merry
Kinetic Investments
“Our very specific requirements can be a challenge—With Upwork, we’re able to access a bigger community to ensure the success of our projects.”
KK
Katja Krohn
Summa Linguae
How do I hire a Scrapy Developer in China on Upwork?
You can hire a Scrapy Developer in China on Upwork in four simple steps:
Create a job post tailored to your Scrapy Developer project scope. We'll walk you through the process step by step.
Browse top Scrapy Developer talent on Upwork and invite them to your project.
Once the proposals start flowing in, create a shortlist of top Scrapy Developer profiles and interview.
Hire the right Scrapy Developer for your project from Upwork, the world's largest work marketplace.
At Upwork, we believe talent staffing should be easy.
How much does it cost to hire a Scrapy Developer?
Rates charged by Scrapy Developers on Upwork can vary with a number of factors including experience, location, and market conditions. See hourly rates for in-demand skills on Upwork.
Why hire a Scrapy Developer in China on Upwork?
As the world's work marketplace, we connect highly-skilled freelance Scrapy Developers and businesses and help them build trusted, long-term relationships so they can achieve more together. Let us help you build the dream Scrapy Developer team you need to succeed.
Can I hire a Scrapy Developer in China within 24 hours on Upwork?
Depending on availability and the quality of your job post, it's entirely possible to sign up for Upwork and receive Scrapy Developer proposals within 24 hours of posting a job description.