Big Data Developer Job Description Template

An effective description can help you hire the best fit for your job. Check out our tips to provide details that skilled professionals are looking for.

Hire Big Data Developers

Looking to find work instead?

Trusted by

Tips for Writing a Big Data Engineer Job Description

A big data engineer is a professional who is responsible for the management of data sets that are too big for traditional database systems to handle. They create, design, and implement data processing jobs in order to transform the data into a more usable format. They also ensure that the data is secure and complies with industry standards to protect the company’s information.

Below, we will cover a sample job description, exploring the daily responsibilities and necessary qualifications for a big data engineer.

Copy to Clipboard

The Job Overview

We are seeking a big data engineer to join our data analytics team. The successful candidate will be responsible for overseeing the creation and maintenance of our database infrastructure, including collecting and maintaining data, ensuring the integrity of our data, and creating and training data models.

Responsibilities

Below are some of the responsibilities of a big data engineer:

Design the architecture of our big data platform
Perform and oversee tasks such as writing scripts, calling APIs, web scraping, and writing SQL queries
Design and implement data stores that support the scalable processing and storage of our high-frequency data
Maintain our data pipeline
Customize and oversee integration tools, warehouses, databases, and analytical systems
Configure and provide availability for data-access tools used by all data scientists

Job Qualifications and Skill Sets

Below are the qualifications expected of a big data engineer:

3 to 5 years of relevant data engineering experience
Bachelor’s degree or higher in computer science, data science, or a related field
Hands-on experience with data cleaning, visualization, and reporting
At least 2 years of relevant experience with real-time data stream platforms such as Kafka and Spark Streaming
Experience working in an agile environment
Familiarity with the Hadoop ecosystem
Experience with platforms such as MapReduce, Apache Cassandra, Hive, Presto, and HBase
Excellent analytical and problem-solving skills
Excellent communication and interpersonal skills

Copy to Clipboard

4 Steps to Creating a Big Data Engineer Job Description That Fits Your Needs

With a big data engineer job description template in hand, it’s time to write that job post. Although you don’t need a complete job description as you would when hiring an employee, aim to provide enough detail for a contractor to know if they’re the right fit for the project. Below are some factors to consider when writing your job description:

1. Determine What Type of Big Data Engineer You Need

The type of big data engineer you need will be determined by how you will use the data output. Some big data engineers work with business intelligence and machine learning platforms to create dashboards and reports for internal use.

Other big data engineers work in environments with data pipelines in order to develop and analyze data to create tools for external clients. Determining your need first will help in understanding the correct type of big data engineer you need.

2. Employee vs. Independent Contractor vs. Agency

A big data engineer can be hired in-house, contracted through an agency, or hired independently as a freelancer. A big data engineer might specialize in certain technologies, such as Hadoop, using programming languages like Java, NoSQL, Python, Hive, Spark, Apache, and Sqoop. In addition, a big data engineer might be well versed in SQL and shell scripting and have experience working in a cloud environment.

No matter which direction you go to fill your needs, an independent contractor might provide the most flexibility, as they can be deployed to any number of projects when needed at a competitive rate. Worker classification can be tricky, so check out our compliance services resources page for more information.

3. Experience

The more experienced a big data engineer is, the more complex tasks they’ll be able to perform for your business. An entry-level big data engineer might help your business with very straightforward projects such as sourcing and compiling data with easy-to-use tools. Alternatively, you might consult with a senior big data engineer to help with advanced projects that feature various platforms, multiple development languages, and a variety of reporting capabilities. Your project scope will determine the type of experience required for the job.

4. Industry

It’s possible a big data engineer can work in any industry. The nature of the work being done can be similar across multiple industries, therefore allowing engineers to have experience in more than one area. There are, however, some big data engineers who specialize in certain industries where analyzing a great deal of data is necessary. Such industries include insurance, banking, consumer goods, auto manufacturing, virtual reality development, and software development.

While you can hire a big data engineer with experience across multiple industries, identifying the right fit might mean finding one who has experience in your industry.

Next Steps

Now that you know how to write an effective big data engineer job description, you’re ready to check out our list of top big data engineers on Upwork. Their qualifications are listed along with their experience, giving you all the information you need to find the right fit for you.

Big Data Developer Hiring Resources

Explore talent to hire

Learn about cost factors

4.8/5

clients rate based on reviews

Hire Big Data Developers

Big Data Developers you can meet on Upwork

$40 hourly
Feras A.
- 5.0
- (21 jobs)
Oakville, ON
Big Data
Financial Statement
Financial Analysis
Tidyverse
Data Analysis
Microsoft Excel PowerPivot
Data Modeling
Automation
R
Power Query
Microsoft Power BI
Data Visualization
SQL
Intuit QuickBooks
With 7+ years of experience in Power BI development, I help businesses transform raw data into actionable insights through scalable dashboards, automated workflows, and financial reporting solutions. I specialize in turning messy row data into interactive, drillable dashboards that save teams hours of manual work while delivering clarity, accuracy, and efficiency. My approach blends technical expertise with a strong focus on finance and process automation—so your data doesn’t just look good, it drives decisions. Core Expertise: 🔹 Power BI Development - Data wrangling (Excel/CSV/TXT/PDF → clean, structured datasets) - Data extraction , automation and integration using R programming , Power Automate and Zapier - Optimized star-schema data models for performance - Advanced DAX (time intelligence, dynamic aggregations, allocations) - Publishing & tenant administration (gateways, security, governance) 🔹 Projects Completed - Direct to customer sales dashboard - Amazon store analysis - RFM Analysis - Cohort Analysis - Profit & Loss (P&L) statements (monthly/quarterly/yearly) - Budget vs. Actuals, YoY, QoQ, MoM comparisons - Multi-entity/cost center breakdowns - Supplier/customer profitability analysis - Multi-currency and fiscal/calendar year support 🔹 Power Platform Solutions -Automating manual tasks (PDF/Excel conversions, file consolidation) -Scheduled data refreshes & seamless integrations Ongoing support & maintenance for reports and datasets Why Work With Me? ✅ Data Clarity: I turn scattered files into clear, interactive dashboards. ✅ Scalable Processes: From inconsistent CSVs to automated reporting pipelines. ✅ Ongoing Partnership: Training, documentation, and long-term support included. 📊 Let’s build reports that save time, improve decisions, and eliminate headaches.
$40 hourly
Rai S.
- 5.0
- (8 jobs)
Lahore, PUNJAB
Big Data
Transact-SQL
Google Cloud Platform
Git
Apache Airflow
Microsoft SQL Server
Data Analysis
Business Intelligence
BigQuery
dbt
PySpark
Machine Learning
SQL
Python
With a strong foundation in Mathematics, Data Engineering, AI, and Cloud Technologies, I specialize in designing and implementing 𝐬𝐜𝐚𝐥𝐚𝐛𝐥𝐞 𝐝𝐚𝐭𝐚 𝐩𝐢𝐩𝐞𝐥𝐢𝐧𝐞𝐬, 𝐦𝐚𝐜𝐡𝐢𝐧𝐞 𝐥𝐞𝐚𝐫𝐧𝐢𝐧𝐠 𝐬𝐨𝐥𝐮𝐭𝐢𝐨𝐧𝐬, and 𝐜𝐥𝐨𝐮𝐝-𝐧𝐚𝐭𝐢𝐯𝐞 𝐚𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭𝐮𝐫𝐞𝐬. My expertise lies in SQL, Python, Spark-hadoop architecture, Databricks, GCP, AWS, and MLOps enabling businesses to unlock insights, optimise performance, and drive AI-powered innovation. I led data teams, with agile work management, driving strategic data initiatives through mentorship, stakeholder collaboration, budget optimization, and a strong commitment to Equality, Diversity, and Inclusion (EDI). 🔹 𝐂𝐥𝐨𝐮𝐝 & 𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫𝐢𝐧𝐠: Architected end-to-end data solutions, including 𝗦𝗤𝗟 𝗦𝗲𝗿𝘃𝗲𝗿 to 𝗕𝗶𝗴𝗤𝘂𝗲𝗿𝘆 and 𝗧𝗲𝗿𝗮𝗱𝗮𝘁𝗮 to 𝗦𝗽𝗮𝗿𝗸-𝗵𝗮𝗱𝗼𝗼𝗽 architecture migrations, ETL/ELT pipelines, and real-time data processing 🔹 𝐀𝐈 & 𝐌𝐚𝐜𝐡𝐢𝐧𝐞 𝐋𝐞𝐚𝐫𝐧𝐢𝐧𝐠: Built ML models using AWS Sagemaker, Tensorflow, Vertex AI, Document AI, Jupyter notebooks for fraud detection, predictive analytics and Fair AI ensuring transparency, data compliance and ethical AI adoption in data lifecycle management 🔹 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 & 𝐀𝐧𝐚𝐥𝐲𝐭𝐢𝐜𝐬: Engineered cost-optimised, high-performance data warehouses, leveraging Data Lake, Databricks, dbt, EMR, Dataproc, PySpark, Cloudera, Kafka, Tableau and Looker for BI solutions 🔹 𝐀𝐮𝐭𝐨𝐦𝐚𝐭𝐢𝐨𝐧 & 𝐃𝐞𝐯𝐎𝐩𝐬: Streamlined deployments with CI/CD (GitHub Actions, Terraform, Cloud Build), improving infrastructure scalability and security. 🔹 𝐑𝐞𝐬𝐞𝐚𝐫𝐜𝐡 & 𝐈𝐧𝐧𝐨𝐯𝐚𝐭𝐢𝐨𝐧: Published research in 𝐩𝐫𝐞𝐬𝐭𝐢𝐠𝐢𝐨𝐮𝐬 𝐯𝐞𝐧𝐮𝐞𝐬 (𝐀𝐂𝐌, 𝐄𝐥𝐬𝐞𝐯𝐢𝐞𝐫) on AI fairness, fraud detection, and intelligent systems. I thrive at the intersection of 𝐭𝐞𝐜𝐡𝐧𝐨𝐥𝐨𝐠𝐲, 𝐩𝐫𝐨𝐛𝐥𝐞𝐦-𝐬𝐨𝐥𝐯𝐢𝐧𝐠, 𝐚𝐧𝐝 𝐢𝐦𝐩𝐚𝐜𝐭, turning complex data challenges into efficient, scalable, and AI-driven solutions. If you're looking for someone to 𝐨𝐩𝐭𝐢𝐦𝐢𝐳𝐞 𝐲𝐨𝐮𝐫 𝐝𝐚𝐭𝐚 𝐚𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭𝐮𝐫𝐞, 𝐬𝐜𝐚𝐥𝐞 𝐀𝐈 𝐬𝐨𝐥𝐮𝐭𝐢𝐨𝐧𝐬, or 𝐦𝐢𝐠𝐫𝐚𝐭𝐞 𝐭𝐨 𝐭𝐡𝐞 𝐜𝐥𝐨𝐮𝐝—let’s connect!
$95 hourly
Stanley B.
- 4.9
- (26 jobs)
Yorba Linda, CA
Big Data
SQL
Apache Kafka
Google Cloud Platform
AWS CloudFormation
Amazon Redshift
Azure Blockchain Service
Databricks Platform
Snowflake
Netezza
Microsoft SQL SSAS
IBM Cloud
Data Warehousing & ETL Software
Cloud Solution Architect with engineering experience in Cloud SQL Big Data technologies including Data Architecture to support various Business Intelligence needs. Solution Architect in Technical Teams on Cloud Data Solutions into various Cubes, Data Marts, and ERP Systems. Developed data structures for business using various Analysis Services Cubes, BI Dashboard, and Scorecards. Recent experiences include developing multiplayer AI Platform with Generative AI using AWS Bedrock for back-office CareManagement application including HealthCare. Implementations included Anthropic Claude model & Twilio Integration for Client Onboarding, Authentication, and Call Flow Management. Cloud Services Database include Snowflake Data Cloud, Azure Cloud, Go/Language (JSON and yaml) with Anaconda python programming. Migrated Data Lakes from on-prem up to SnowFlake using SnowPipe and SnowSQL using command line scripts using AI methods. Implemented standards and data designs for HIPAA, SOX, regulatory, compliance, financial, reporting, and auditing. Next generation AI development with Anthropic Claude Code, ChatGPT, Gemini, etc.

$40 hourly
Feras A.
- 5.0
- (21 jobs)
Oakville, ON
Big Data
Financial Statement
Financial Analysis
Tidyverse
Data Analysis
Microsoft Excel PowerPivot
Data Modeling
Automation
R
Power Query
Microsoft Power BI
Data Visualization
SQL
Intuit QuickBooks
With 7+ years of experience in Power BI development, I help businesses transform raw data into actionable insights through scalable dashboards, automated workflows, and financial reporting solutions. I specialize in turning messy row data into interactive, drillable dashboards that save teams hours of manual work while delivering clarity, accuracy, and efficiency. My approach blends technical expertise with a strong focus on finance and process automation—so your data doesn’t just look good, it drives decisions. Core Expertise: 🔹 Power BI Development - Data wrangling (Excel/CSV/TXT/PDF → clean, structured datasets) - Data extraction , automation and integration using R programming , Power Automate and Zapier - Optimized star-schema data models for performance - Advanced DAX (time intelligence, dynamic aggregations, allocations) - Publishing & tenant administration (gateways, security, governance) 🔹 Projects Completed - Direct to customer sales dashboard - Amazon store analysis - RFM Analysis - Cohort Analysis - Profit & Loss (P&L) statements (monthly/quarterly/yearly) - Budget vs. Actuals, YoY, QoQ, MoM comparisons - Multi-entity/cost center breakdowns - Supplier/customer profitability analysis - Multi-currency and fiscal/calendar year support 🔹 Power Platform Solutions -Automating manual tasks (PDF/Excel conversions, file consolidation) -Scheduled data refreshes & seamless integrations Ongoing support & maintenance for reports and datasets Why Work With Me? ✅ Data Clarity: I turn scattered files into clear, interactive dashboards. ✅ Scalable Processes: From inconsistent CSVs to automated reporting pipelines. ✅ Ongoing Partnership: Training, documentation, and long-term support included. 📊 Let’s build reports that save time, improve decisions, and eliminate headaches.
$40 hourly
Rai S.
- 5.0
- (8 jobs)
Lahore, PUNJAB
Big Data
Transact-SQL
Google Cloud Platform
Git
Apache Airflow
Microsoft SQL Server
Data Analysis
Business Intelligence
BigQuery
dbt
PySpark
Machine Learning
SQL
Python
With a strong foundation in Mathematics, Data Engineering, AI, and Cloud Technologies, I specialize in designing and implementing 𝐬𝐜𝐚𝐥𝐚𝐛𝐥𝐞 𝐝𝐚𝐭𝐚 𝐩𝐢𝐩𝐞𝐥𝐢𝐧𝐞𝐬, 𝐦𝐚𝐜𝐡𝐢𝐧𝐞 𝐥𝐞𝐚𝐫𝐧𝐢𝐧𝐠 𝐬𝐨𝐥𝐮𝐭𝐢𝐨𝐧𝐬, and 𝐜𝐥𝐨𝐮𝐝-𝐧𝐚𝐭𝐢𝐯𝐞 𝐚𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭𝐮𝐫𝐞𝐬. My expertise lies in SQL, Python, Spark-hadoop architecture, Databricks, GCP, AWS, and MLOps enabling businesses to unlock insights, optimise performance, and drive AI-powered innovation. I led data teams, with agile work management, driving strategic data initiatives through mentorship, stakeholder collaboration, budget optimization, and a strong commitment to Equality, Diversity, and Inclusion (EDI). 🔹 𝐂𝐥𝐨𝐮𝐝 & 𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫𝐢𝐧𝐠: Architected end-to-end data solutions, including 𝗦𝗤𝗟 𝗦𝗲𝗿𝘃𝗲𝗿 to 𝗕𝗶𝗴𝗤𝘂𝗲𝗿𝘆 and 𝗧𝗲𝗿𝗮𝗱𝗮𝘁𝗮 to 𝗦𝗽𝗮𝗿𝗸-𝗵𝗮𝗱𝗼𝗼𝗽 architecture migrations, ETL/ELT pipelines, and real-time data processing 🔹 𝐀𝐈 & 𝐌𝐚𝐜𝐡𝐢𝐧𝐞 𝐋𝐞𝐚𝐫𝐧𝐢𝐧𝐠: Built ML models using AWS Sagemaker, Tensorflow, Vertex AI, Document AI, Jupyter notebooks for fraud detection, predictive analytics and Fair AI ensuring transparency, data compliance and ethical AI adoption in data lifecycle management 🔹 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 & 𝐀𝐧𝐚𝐥𝐲𝐭𝐢𝐜𝐬: Engineered cost-optimised, high-performance data warehouses, leveraging Data Lake, Databricks, dbt, EMR, Dataproc, PySpark, Cloudera, Kafka, Tableau and Looker for BI solutions 🔹 𝐀𝐮𝐭𝐨𝐦𝐚𝐭𝐢𝐨𝐧 & 𝐃𝐞𝐯𝐎𝐩𝐬: Streamlined deployments with CI/CD (GitHub Actions, Terraform, Cloud Build), improving infrastructure scalability and security. 🔹 𝐑𝐞𝐬𝐞𝐚𝐫𝐜𝐡 & 𝐈𝐧𝐧𝐨𝐯𝐚𝐭𝐢𝐨𝐧: Published research in 𝐩𝐫𝐞𝐬𝐭𝐢𝐠𝐢𝐨𝐮𝐬 𝐯𝐞𝐧𝐮𝐞𝐬 (𝐀𝐂𝐌, 𝐄𝐥𝐬𝐞𝐯𝐢𝐞𝐫) on AI fairness, fraud detection, and intelligent systems. I thrive at the intersection of 𝐭𝐞𝐜𝐡𝐧𝐨𝐥𝐨𝐠𝐲, 𝐩𝐫𝐨𝐛𝐥𝐞𝐦-𝐬𝐨𝐥𝐯𝐢𝐧𝐠, 𝐚𝐧𝐝 𝐢𝐦𝐩𝐚𝐜𝐭, turning complex data challenges into efficient, scalable, and AI-driven solutions. If you're looking for someone to 𝐨𝐩𝐭𝐢𝐦𝐢𝐳𝐞 𝐲𝐨𝐮𝐫 𝐝𝐚𝐭𝐚 𝐚𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭𝐮𝐫𝐞, 𝐬𝐜𝐚𝐥𝐞 𝐀𝐈 𝐬𝐨𝐥𝐮𝐭𝐢𝐨𝐧𝐬, or 𝐦𝐢𝐠𝐫𝐚𝐭𝐞 𝐭𝐨 𝐭𝐡𝐞 𝐜𝐥𝐨𝐮𝐝—let’s connect!
$95 hourly
Stanley B.
- 4.9
- (26 jobs)
Yorba Linda, CA
Big Data
SQL
Apache Kafka
Google Cloud Platform
AWS CloudFormation
Amazon Redshift
Azure Blockchain Service
Databricks Platform
Snowflake
Netezza
Microsoft SQL SSAS
IBM Cloud
Data Warehousing & ETL Software
Cloud Solution Architect with engineering experience in Cloud SQL Big Data technologies including Data Architecture to support various Business Intelligence needs. Solution Architect in Technical Teams on Cloud Data Solutions into various Cubes, Data Marts, and ERP Systems. Developed data structures for business using various Analysis Services Cubes, BI Dashboard, and Scorecards. Recent experiences include developing multiplayer AI Platform with Generative AI using AWS Bedrock for back-office CareManagement application including HealthCare. Implementations included Anthropic Claude model & Twilio Integration for Client Onboarding, Authentication, and Call Flow Management. Cloud Services Database include Snowflake Data Cloud, Azure Cloud, Go/Language (JSON and yaml) with Anaconda python programming. Migrated Data Lakes from on-prem up to SnowFlake using SnowPipe and SnowSQL using command line scripts using AI methods. Implemented standards and data designs for HIPAA, SOX, regulatory, compliance, financial, reporting, and auditing. Next generation AI development with Anthropic Claude Code, ChatGPT, Gemini, etc.
$200 hourly
Toan H.
- 5.0
- (50 jobs)
Swanley, GREATER LONDON
Big Data
Project Management
Data Science
Stakeholder Management
Data Modeling
Data Warehousing
Business Intelligence
Data Visualization
API Integration
SQL
Tableau
Data Analysis
Tableau Visionary (2020, 2021, and 2022) for Excellence in Teaching, Mastery of the Platform, and Collaborator. I have worked in Business Intelligence, Data Management and Digital Transformation since 2004 and dedicated the last seven years to help people get the most out of their Tableau investments; I can assist you with all aspects of Tableau from developing dashboards, administrating and setting up your enterprise infrastructure, to developing customer Extensions or other technical integrations. If you require support in your projects, do get in touch.
$90 hourly
Mihail K.
- 5.0
- (31 jobs)
Shtip, ŠTIP
Big Data
Data Mining
GitLab
Docker
Google Cloud Platform
PostgreSQL
BigQuery
Terraform
Apache Spark
Amazon Web Services
Apache Airflow
Data Scraping
Python
ETL Pipeline
SQL
I have 6 years of experience in ETL, Big Data processing, streaming, web scraping, and infrastructure as code using Terraform. Technologies I work with: ETL: Python, Scala, PySpark, Airflow Storage: BigQuery, Cloud Storage, S3 Streaming: Apache Beam, GCP DataFlow Web Scraping: Python Databases: PostgreSQL, MongoDB, InfluxDB Infrastructure as Code: Terraform Visualization: Grafana Vendors: GCP, AWS My specialization lies in providing end-to-end solutions, ensuring seamless processes in ETL, robust handling of Big Data, efficient streaming capabilities, effective web scraping, and proficient database management. I am well-versed in utilizing Python, PySpark, and Airflow for smooth data extraction, transformation, and loading. Leveraging Apache Beam and GCP DataFlow, I enable real-time data processing. I also utilize PostgreSQL and MongoDB to efficiently store and organize data. With my expertise in Terraform, I bring automation to infrastructure management, making provisioning and maintenance hassle-free. Let's collaborate and transform your data into valuable insights. Reach out to me now, and together, we can leverage my expertise in ETL, Big Data processing, streaming, web scraping, and database management, backed by the convenience of infrastructure as code with Terraform!
$35 hourly
Mohamed R.
- 4.7
- (20 jobs)
El Aiun, Morocco
Big Data
Marketing Analytics
Machine Learning
API Integration
Django
Stata
R Shiny
Statistics
Statistical Programming
Data Scraping
Python
R
pandas
Data Mining
Are you looking for data-driven solutions to solve complex business problems? I specialize in Machine Learning, Data Mining, and Statistical Modeling using R, R Shiny, and Python (FastAPI) to build smart, scalable, and insightful applications. With strong hands-on experience in R/RStudio, Python (Scikit-learn), and FastAPI, I deliver end-to-end solutions — from data preprocessing and feature engineering to model deployment and interactive dashboards. 🔍 My Machine Learning Services Include: Predictive Modeling for Business Optimization Feature Engineering & Data Transformation Classification, Clustering, and Regression Association Rule Mining & Affinity Analysis Supervised & Unsupervised Learning Hypothesis Testing and Correlation Analysis Software Defect Prediction & Natural Language Inference Time-Series Forecasting & Trend Analysis Customized Data Visualizations in R, Python, or Shiny Model Deployment via FastAPI or Interactive R Shiny Dashboards 📊 Tools & Technologies I Use: Languages: R, Python Libraries: Scikit-learn, Pandas, Numpy, ggplot2, plotly Frameworks: FastAPI, R Shiny, RMarkdown ML Algorithms: Linear & Logistic Regression k-Nearest Neighbors (kNN) Decision Trees & Random Forest K-Means Clustering Naive Bayes Neural Networks & Deep Learning Support Vector Machines (SVM) Reinforcement Learning (where applicable) 🛠 I Work With: Business analysts, researchers, and startups Teams needing rapid prototype dashboards (R Shiny) Organizations deploying ML models with APIs (FastAPI) Whether you need a predictive model to forecast sales, a clustering algorithm to segment customers, or a full-featured dashboard to visualize insights — I’m here to help you turn data into decisions. 📩 Let’s work together to bring your data to life.
$40 hourly
Rizwan H.
- 5.0
- (17 jobs)
Islamabad, PAKISTAN
Big Data
Microsoft Azure SQL Database
Data Warehousing & ETL Software
Informatica
Data Mining
Google Sheets
Microsoft Excel
Cloud Computing
Data Collection
Data Visualization
Data Labeling
Data Science
Python
Machine Learning
Natural Language Processing
🚀 Transform Your Data into Powerful Insights with a Dedicated Senior Data Engineer! 🚀 I am a Teradata Certified Data Engineer with passion for turning raw data into actionable insights. Armed with excellent analytical, problem-solving, and communication skills, I specialize in ETL Pipeline design & development. My hands-on experience with Power BI allows me to create compelling reports that drive decision-making. Having worked on enterprise-level Data warehouse projects for clients in the US, Canada and UK, particularly within Real Estate and Retail domains, I bring a focused, professional, and collaborative approach to every project. I bring in comprehensive understanding of the entire Data warehouse lifecycle (Data Modeling, Design, ETL, BI reporting). Here's how I can help you succeed: 🌟 No Data? No Problem! I’ll source/scrape high-quality data tailored to your needs. 🌟 Messy Data? I’ve Got You Covered! I’ll clean, transform and organize your data for accurate analysis. 🌟 Unsure What to Do with Your Data? I’ll analyze it, uncover valuable insights, and create stunning visualizations! 🌟 Building a Machine Learning Model? I’ll leverage state-of-the-art techniques to develop the best model possible! Why Hire Me? Quality Work, Delivered Promptly – I ensure top-notch results every time. Always On-Time – Your deadlines are my priority. Clear Communication – I keep you in the loop every step of the way. Continued Support – I’m here for you, even after the project ends. Accuracy & Precision – Detail-oriented and meticulous. Cost-Effectiveness – High-quality service without breaking the bank. Skills Summary: Data Integration Tools: Informatica, SSIS, Pentaho, GCFR Programming Languages: SQL, Python, C/C++, Java Big Data Tools: Hadoop, Spark, PySpark, Kafka Cloud Technologies: S3, Redshift, Glue, Kinesis, Databricks, Azure Data Factory Data Orchestration: Airflow, Control-M Reporting: Power BI CI/CD & Automation: Jenkins, DBT Databases: Teradata, MySQL, Oracle, Neo4J, GraphDB Ready to See the Difference? Contact Me Now! 📞 Schedule a Demo: Let's discuss your project needs and see how I can help you achieve your goals. Whether you need a quick data cleanup or a comprehensive data strategy, I'm here to provide tailored solutions that fit your unique requirements. If your project requires it, I can also assemble a team of skilled professionals to ensure we meet all your needs efficiently and effectively. Let’s turn your data into your most valuable asset. Get in touch, and let’s make your project a success! 🌟
$80 hourly
Archana G.
- 5.0
- (11 jobs)
Milpitas, CA
Big Data
Data Visualization
Artificial Intelligence
Data Analysis
Microsoft Excel
SQL
Machine Learning
Keras
Computer Vision
TensorFlow
Data Science
Tableau
Python
Convolutional Neural Network
Deep Neural Network
Hello, I am a data scientist with 5+ years of experience in data science field. I specialize in all facets of data science: data cleaning, data transformation, data visualization, data analysis, and data modeling using machine learning and deep learning algorithms. Do you have a project that requires data science expertise? Don't hesitate to get in touch with me. I would love to answer your questions or requests. I can help with one-time projects or long-time projects. Work Experience Data Scientist –– Wonder Chrome (December 2021 - PRESENT) Actively engaged in data collection, data cleaning, feature engineering, developing models, validation, dashboard and report generation. ● Maintained and developed complex SQL queries, stored procedures, views, functions, and reports that meet customer requirements using Redshift, Sagemaker, SQL, and Python. ● Developed predictive models, classification model and time series forecasting models using various machine learning tools ● Developed Large-scale multi-label text classification model using Tensorflow and Keras Artificial Intelligence Engineer Intern –– Uniquify Inc (August 2021 - October 2021 ) ● Tensorflow and neural network training ● Debugging the framework for automating neural network and tensorflow scripts ● Running experiments with the tensorflow scripts produced by the framework ● Manipulating data and neural network structure and specs to optimize accuracy in the neural networks ● Analyze the results from training the neural network models to better understand and improve the models and frameworks ● developing image processing and image segmentation algorithms Data Analyst –– Centriqe Inc (February 2020 - January 2021) ● Provide insights and proposals to support business improvement using analytical and technical expertise ● Build predictive models and forecasting models using various machine learning tools ● Actively engaged in the quantitative analysis of sophisticated models to address business issues ● Identify the trends and key metrics and generate dashboards using various data visualization tools. Technical Skills Languages : Python, R Deep learning and AI: TensorFlow, Keras, CNN, RNN, Machine Learning and Data Mining : Bayesian classifiers, Linear classifiers and regression, KNN, Decision trees, Ensemble learning, k-means clustering, Neural networks,Performance evaluation Hyperparameter tuning, Natural Language Processing, Transfer learning Data Analysis : Data manipulation techniques, Plotting and visualisation, Exploratory data analysis, Estimation techniques, Regression model, Classification model Tools : AWS, SQL, OpenCV, Sklearn, YOLO,VGG16, ResNet, Pandas, Numpy, Matplotlib, Tableau, Dash, Plotly, Excel, Elasticsearch, Logstash, Kibana, Spacy, Matlibplot, Seaborn, Tableau, BeautifulSoup, MongoDB, PySpark, Retool,Google sheet, Streamlit
$34 hourly
Sergey T.
- 5.0
- (12 jobs)
Kyiv, KYIV CITY
Big Data
Elasticsearch
Technical Support
pandas
Infrastructure as Code
Linux System Administration
Data Ingestion
Management Skills
Data Processing
Python
I'm a tech professional with 20+ years in IT and over 8 years in backend leadership roles, currently working on Ukrainian army digitalization. I bring a strong combination of software engineering and DevOps mindset, having worked in multiple startups and corporates where I not only built backend systems but also automated deployments, optimized infrastructure, and set up CI/CD pipelines to save teams time and reduce friction. I’ve delivered solutions for top-tier clients like Barclays, Bridgewater, Emotive, and Helu, working across product and outsourcing companies in the banking, fintech, and data processing domains. 🔹 What I bring to the table: - Python (FastAPI, Django) - Scalable backend architecture & microservices - Data processing pipelines - PostgreSQL, MySQL, MongoDB - CI/CD automation with GitHub Actions, serverless deployments - Infrastructure as Code with Terraform - Cloud experience: AWS, DigitalOcean - Team leadership, mentoring & process improvement Outside of work, I enjoy teaching Python and building messenger bots and automation tools. Now that I have some extra availability, I’m here on Upwork to partner on impactful projects — where I can write clean code, automate delivery, and help teams move faster and smarter. Let’s connect and build something great.
Want to browse more talent?
Sign up