Data Engineer for Iceberg, Trino, Spark

Posted 2 days ago

Worldwide

Summary

We are seeking a skilled Data Engineer to work on a project involving Iceberg, Trino, Spark, Airflow, dbt, object storage, and portable GCP-to-MinIO deployment. The ideal candidate will have experience in data integration, processing, and storage, with a strong understanding of cloud technologies. Responsibilities include designing and implementing data pipelines, optimizing data processing workflows, and ensuring data integrity across different systems.

Less than 30 hrs/week
Hourly
1-3 months
Duration
Intermediate
Experience Level
$25.00
-
$50.00
Hourly
Remote Job
Ongoing project
Project Type

Skills and Expertise

Mandatory skills

Apache Hadoop

SAS

Nice-to-have skills

Apache Spark

Algorithm Development

Activity on this job

Proposals:50+
Last viewed by client:2 days ago
Interviewing:
0
Invites sent:
0
Unanswered invites:
0

About the client

Member since Feb 20, 2021

United States
Newark6:51 AM
$2.1K total spent
5 hires, 2 active
Tech & IT
Small company (2-9 people)

Explore similar jobs on Upwork

Data Governance- Atlan, Unity CatalogHourly‐ Posted 4 weeks ago

Data Engineering

Data Engineer for API PipelinesHourly‐ Posted 5 days ago

Python

Data Integration

Database Architecture

Data Transformation

ETL Pipeline

Data Preprocessing

SQL

Database Design

Data Engineering

Data Migration

API Development

Tableau

Google Cloud Platform

How it works

Create your free profile
Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you want
Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securely
From contract to payment, we help you work safely and get paid securely.