Data Engineer for Football Historical Tick Data

Posted 4 hours ago

Worldwide

Summary

We are seeking a skilled Data Engineer to develop a data pipeline for historical football tick data. The role involves designing and implementing a system to collect, process, and store large volumes of data. The ideal candidate will have experience in data engineering and a strong understanding of data structures and algorithms. Familiarity with cloud platforms and data visualization tools is a plus. I am building a rigorous quantitative backtesting operation and require a highly skilled data engineer to process and structure historical in-play tick data for European major leagues. The final deliverable must be a clean, timestamped dataset ready for ingestion into a PostgreSQL/TimescaleDB architecture. The Scope of Work: I require a complete dataset of high-frequency, tick-by-tick exchange odds for a full recent season (including the final stretch up to April 2026). The data must be parsed into a clean relational format. The dataset must include: Pre-match and in-play odds for the Match Odds (1X2) market. Precise timestamping (to the millisecond) to accurately evaluate time decay. The Bid-Ask spread (best back/lay prices) and the matched volume/liquidity available at each tick. Live score state cleanly mapped to the exact market timestamps. Deliverables: Data Processing: You will process raw historical exchange data (e.g., JSON stream files) and parse it into a clean, normalized structure. (If you have access to a legally compliant B2B historical data feed, please specify). Database Integration: Provide the necessary Python scripts to efficiently format and bulk-load this massive dataset into a local PostgreSQL database optimized with TimescaleDB. Data Validation Script: Write a sample Python backtest script utilizing pandas and psycopg2.

  • $5.00

    Fixed-price
  • Intermediate
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
SAS
Data Science
Nice-to-have skills
Machine Learning
Data Analysis
Activity on this job
  • Proposals:Less than 5
  • Last viewed by client:2 hours ago
  • Interviewing:
    1
  • Invites sent:
    3
  • Unanswered invites:
    1
About the client
Member since Jun 12, 2022
  • Kenya
    Nairobi3:25 PM
  • $500 total spent
    1 hire, 1 active

Explore similar jobs on Upwork

Data Governance- Atlan, Unity CatalogHourly‐ Posted 4 weeks ago
Data Engineering
Clickup Workspace Design and StructureHourly‐ Posted 2 months ago
ClickUp

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo