Data Pipeline Engineer – GCP & Distributed Data Processing

Posted 2 weeks ago

Worldwide

Summary

We are looking for a Data Pipeline Engineer who can help us design and build reliable, scalable data systems on Google Cloud Platform (GCP). In this role, you will work with large volumes of data and make sure it flows smoothly from different sources into clean, usable formats for analytics and business use. This includes working with JSON files, APIs, databases, and document-based data like PDFs. You’ll be responsible for building and maintaining ETL pipelines, improving data processing performance, and making sure our systems are stable, fast, and production-ready. We care a lot about clean architecture, proper monitoring, and handling failures gracefully. You will also work on distributed data processing systems (like Spark or similar tools) to handle large-scale workloads efficiently in the cloud. What you’ll do: Design and build scalable ETL/ELT pipelines on GCP Process and transform large datasets (structured + unstructured) Work with APIs, JSON data, and document-based inputs (PDFs, etc.) Improve performance and reliability of existing data workflows Collaborate with engineering and analytics teams Ensure data quality, consistency, and observability If you enjoy working with large-scale data systems and building clean, efficient pipelines that power real products, this role will be a great fit. Start your proposal with word "Data Engineer" otherwise you will not be considered.

  • $100.00

    Fixed-price
  • Expert
    Experience Level
  • Remote Job
  • One-time project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
Data Engineering
Database Design
Activity on this job
  • Proposals:20 to 50
  • Last viewed by client:last week
  • Hires:
    1
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Aug 23, 2025
  • United Kingdom
    Belfast9:32 AM
  • $8.3K total spent
    234 hires, 8 active
  • 240 hours

Explore similar jobs on Upwork

Database University AssignmentsHourly‐ Posted 9 months ago
SQL
Database
Microsoft Excel
Database Design
Database Management
SQL Server Integration Services
Excel Macros
Excel Formula
Microsoft Power BI
Microsoft Excel PowerPivot
Power Query
Data Entry
Data Cleaning
Data Analytics
Data Extraction
AWS Glue
Apache Kafka
Python
HubSpot
Salesforce CRM
REST API
Node.js

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo