Upwork home
Sign up
Secondary

Hire the best Big Data Engineers

Check out Big Data Engineers with the skills you need for your next job.
Hire freelancers
Clients rate Big Data Engineers
Rating is 4.8 out of 5.
4.8/5
based on 1,697 client reviews
  • $60 hourly

    • 5.0/5
    • (39 jobs)
    ✅ AWS Certified Solutions Architect ✅ Google Cloud Certified Professional Data Engineer ✅ SnowPro Core Certified Individual ✅ Upwork Certified Top Rated Professional Plus ✅ The author of Python package for cryptocurrency market Currency.com (python-currencycom) Specializing in Business Intelligence Development, ETL Development, and API Development with Python, Apache Spark, SQL, Airflow, Snowflake, Amazon Redshift, GCP, and AWS. Accomplished lots of complicated and not very projects like: ✪ Highly scalable distributed applications for real-time analytics ✪ Designing data Warehouse and developing ETL Pipelines for multiple mobile apps ✪ Cost optimization for existing cloud infrastructure But the main point: I have a responsibility for the final result.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Data Scraping
    Snowflake
    ETL
    BigQuery
    Amazon Redshift
    Data Engineering
    Cloud Architecture
    Google Cloud Platform
    ETL Pipeline
    Python
    Amazon Web Services
    Apache Airflow
    SQL
    Apache Spark
  • $30 hourly

    • 4.9/5
    • (28 jobs)
    My primary interest is working with data and building solutions to complex data problems. I can help with Data wrangling and modeling. I can help Perform custom ETL jobs and build data pipelines via Pyspark, AWS Glue, etc. With my rich data visualization and dashboarding experience, I can help develop insightful dashboards with robust KPI metrics, which are critical to business decision-making using R-shiny, Tableau, and PowerBI. In addition, I can help with related statistical tasks using Excel and R. I can help with building complex optimization models that help address various logistics and scheduling problems.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Data Modeling
    Dashboard
    A/B Testing
    Data Analysis
    Microsoft Power BI
    RStudio
    Data Visualization
    Microsoft Excel
    SQL
    Tableau
    Mathematics
    Linear Regression
    Python
  • $40 hourly

    • 5.0/5
    • (31 jobs)
    I hold a PhD in Bioinformatics and have been working as consultant for over a year, delivering tailored solutions for a variety of bioinformatics challenges. I also have extensive hands-on expertise in developing bioinformatics tools for a wide range of analyses, including those with multi-omics data. Over the past nine years, I have honed my skills through multidisciplinary collaborative projects. My expertise includes automating processes by creating custom pipelines designed to address specific research questions involving next-generation sequencing (NGS) data. Coding in Python and R is part of my daily work. If you’re looking for a flexible and effective solution to your scientific challenges, feel free to reach out—I’d be happy to discuss how I can assist with your project.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Software Design
    Bash
    Data Science
    Scientific Research
    R
    pandas
    Python
    Genomic Data Analysis
    Sequence Analysis
    Genetics
    Bioinformatics
  • $50 hourly

    • 4.9/5
    • (24 jobs)
    ETL developer and Data Warehouse Architect with 17 years of experience in retail, financial, telecom, pharma, and airline business areas. I specialize in data integration solutions. If you need to build a BI/DWH/Database solution from scratch till production or need support in some part of the project - don't hesitate to contact me. I can help you in these areas - BI Solution Architecture Development (Software, Hardware layers) - Data Warehouse project (ROLAP, MOLAP) - Data Model Design (Logical, Physical, Star/Snowflake, Multidimensional, Data Vault) - Database design (Oracle, MS SQL, Netezza, Vertica, PostgreSQL) - Data Management Design (Migration, Integration, Replication and any data processing) - ETL development (Datastage, Informatica, SSIS, Talend, ODI, OWB) - Data Quality and Data Cleansing - Create complex DB Server-side logic (Procedures/Functions, UDF/UDA) - Performance tuning (SQL queries, PL/SQL, T-SQL, NZSQL) I knew and used: ETL Tools - DataStage, Talend for Integration, Informatica Power Center and IICS, SSIS, Oracle DI/GG, AWS DMS/SCT Databases - Oracle, MS SQL Server, PostgreSQL, Netezza, Vertica, AWS Redshift, Snowflake
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Talend Open Studio
    Snowflake
    Data Management
    Data Integration
    IBM DataStage
    Informatica
    ETL
    Business Intelligence
    Data Warehousing
    Amazon Redshift
    Cloud Migration
    Database Design
    ETL Pipeline
    Data Modeling
  • $50 hourly

    • 5.0/5
    • (2 jobs)
    Results-driven data engineer with nearly 8 years of experience in designing and implementing new systems, optimizing legacy solutions, and migrating enterprise solutions to the cloud. I have a proven track record of delivering tailored data-driven solutions for US-based clients, leveraging my expertise in programming and data engineering. I excel at tackling complex challenges, continuously learning modern technologies, and contributing effectively to collaborative teams. Key Skills: Data Lifecycle Management Data Integration and Ingestion Data Pipeline Development Data Automation Optimization Data Quality ETL (Extract, Transform, Load) and ELT Database DWH(Data Warehouses) ETL Orchestration Proficient in SQL Snowflake, AWS Redshift, IBM Netezza, PostgreSQL, Azure DB, MS SQL Server DBT, Fivetran, IBM Informatica, SSIS, ADF Airflow for Data Workflow Orchestration ThoughSpot PowerShell Python Git and Version Control Jira and Confluence etc. These skills and extensive experience make me a valuable asset in any data engineering project. I am committed to delivering high-quality solutions and staying at the forefront of data engineering advancements.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    ETL
    dbt
    Informatica
    Amazon Redshift
    Snowflake
    ETL Pipeline
    Data Transformation
    Data Ingestion
    Data Integration
    Data Engineering
    Data Warehousing & ETL Software
    Database
    Apache Airflow
    Python
    SQL
  • $35 hourly

    • 4.9/5
    • (16 jobs)
    I am Big data engineer / Scala developer with 16 years of experience with the full software development lifecycle. My primary languages are Scala and Java, with experience in development frameworks such as Play, Akka, Slick. Database competencies include RDBMS (PostgreSQL, MySQL) and Big Data (Spark, Hadoop, HBase, Sqoop, Pig, Hive, Vertica, Kafka). Expertise in working throughout the projects full-lifecycle, had worked on every phase. Experience in Agile delivery of software using practices from Scrum, Kanban etc. I am very keen to learn new technologies and business knowledge. I accept challenges and can work independently without a close assistance. For employment prospective I am open to contract role and on negotiable rates. I can make assure my stability with company and available immediately. Buzzwords: Scala, Hadoop, HBase, Hive, Zookeper, Vertica, Redis, hand-made DB with offheap storage, Play Framework, Slick, Akka, Java SE, Java EE, Spring, EJB, Hibernate, MyBatis, Vaadin, Struts, JSTL, JSP. PostgreSQL, PL/SQL, MySql Javascript, Prototype, Dojo, ExtJs Jboss, Tomcat Intellij IDEA, Eclipse
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Apache HBase
    Vertica
    Akka
    Java
    Scala
    Apache Spark
    Apache Hive
    PostgreSQL
    Apache Hadoop
  • $120 hourly

    • 5.0/5
    • (55 jobs)
    - 5+ years of DevOps/Cloud experience - Over 40 satisfied clients with a 97% job success rate and Top Rated Plus in Upwork - Certified Kubernetes Application Developer and AWS Certified Developer - Certified Google Cloud Architect - Lead DevOps/Cloud Engineer - 7+ years of experience in IT - Conduct public webinars and workshops An enthusiastic DevOps and Cloud Engineer having extensive experience in Containerization, Continuous Integration, Continuous Deployment, Infrastructure As Code, and Monitoring Solutions. I am a Certified Kubernetes Application Developer and a Certified AWS Developer Associate with experience in implementing automation in different phases of the Software Development Life Cycle. I also possess experience in infrastructure in the cloud and deployment of applications in on-premise and cloud servers. I have also been conducting public webinars and workshops I work on the following technologies : Clouds ===== AWS, GCP, AZURE, and Digitial Ocean Containerization ============ Docker,Kubernetes, docker-compose, docker swarm, GKE, AKS,EKS, Helm,Openshift CI/CD ===== Github Actions,Gitlab CI, Bitbucket pipelines, Tekton, ArgoCD, Github Actions ,Circle CI,Jenkins Infrastructure As Code ================= Terraform, Cloudformation Programming/Scripting Language ================== Golang, python, bash , nodeJS Monitoring & Logging =============== Prometheus, Grafana, ELK stack, cloud logging, cloud watch logging, Kibana I also possess key soft skills such as communication, self-learning, self-management, and leadership which are crucial for any role. I am also fluent in English and easy to go by. For more details, you are always welcome to contact me.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Cloud Computing
    DevOps
    Google Cloud Platform
    Kubernetes
    Jenkins
    Node.js
    CI/CD
    Docker
    HTML5
    React
    CSS 3
  • $40 hourly

    • 4.9/5
    • (864 jobs)
    I am an experienced and proficient web scraper using Python to obtain very large amounts of data from a variety of online sources. I do fixed-price work and have successfully pulled data from 100's of sites with examples being business locations, directories, public information, IMDB movie info, sports-reference stats, music charts, Forbes company rankings/info, ESPN player pages, Google search results, as well as hundreds of other queries of all genres. You can see some of my results via the data sets which are used on my big data quiz site, hugequiz.com. I have been able to retrieve data from articles, tables, lists, recursively via search results, from sites with AJAX/Javascript, and even when authentication is required. Any project you have I would be able to discuss and preview the site(s) which need to be scraped in order to provide you the output you are looking for in .CSV or other format.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Data Scraping
    Python
    Microsoft Excel
  • $40 hourly

    • 5.0/5
    • (13 jobs)
    Greetings, With over 7 years of experience in both technical and commercial domains, I have gained valuable expertise in diverse areas such as web development, software architecture, product design, DevOps engineering, infrastructure management, and analytics/visualization/modeling for geospatial data. My journey has led me to master numerous modern frameworks and libraries. I am deeply inclined towards fostering creativity and embracing continuous improvement in my development endeavors. Throughout my career, I've had the privilege of being part of some remarkable projects that have contributed to my growth and reputation. These experiences have not only added to my skill set but also instilled a sense of accomplishment. I am eager to share my advanced knowledge and insights with you, with the aim of assisting you in achieving your goals and driving your success. I'm eagerly looking forward to the opportunity of connecting with you soon. Regards, Viknesh Subramanian
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Data Warehousing & ETL Software
    Data Warehousing
    Data Visualization
    ETL Pipeline
    Business Intelligence
    RESTful API
    GraphQL
    Serverless Computing
    Cloud Computing
    TypeScript
    Infrastructure as Code
    Amazon Web Services
    Python
    Node.js
  • $25 hourly

    • 5.0/5
    • (28 jobs)
    With over 18 years of experience in Full-Stack Development (MERN, Python), AI, and Data Engineering, I have a proven track record of building and scaling web applications, data pipelines, and real-time systems for enterprise-level customers. As a Top-Rated Plus freelancer with a 100% Job Success Rate and over $50K earned on Upwork, I specialize in MERN stack development, API integration, and cloud infrastructure to deliver scalable, high-performance ERP applications and complex systems. Key Expertise: As a MERN Stack Developer, I specialize in React.js and Node.js with expertise in designing scalable service APIs (REST, SOAP, GraphQL, Microservices) hosted on cloud environments like AWS. I excel in performing code reviews, ensuring optimal performance, and writing reusable code that enhances scalability and security. Full-Stack Development Expertise: Expertise in React.js (Hooks), Node.js, MongoDB, Express.js, and Apollo for front-end and back-end development. Experience building and optimizing secured backend APIs consumed by multiple applications (web and mobile). Developing highly scalable APIs using GraphQL, RESTful services, and Microservices architecture. Building complex ERP systems with enterprise-level clients, ensuring performance, scalability, and security. Experience with Socket.IO for real-time communication. Cloud Infrastructure: I bring hands-on experience with AWS services like EC2, S3, RDS, Lambda, ElasticSearch, API Gateway, and more. My proficiency in cloud infrastructure ensures that applications are designed, deployed, and managed in a highly scalable and secure manner. Cloud and DevOps Expertise: AWS EC2, S3, Lambda, ElasticSearch, Elastic Beanstalk, API Gateway, RDS, SQS, EC2 Container Service for cloud environments. CI/CD pipelines with GitLab, Jenkins, and automated testing to deliver reliable and efficient software solutions. Security implementation using OAuth 2.0, JWT, and SSL/TLS. Responsibilities & Key Contributions: As part of large-scale projects, I provide code review services to ensure that the code meets industry standards and best practices. I also contribute by fixing bugs and implementing new modules as needed to ensure smooth delivery and continuous improvement of the application. Advanced Skills: Writing reusable code and optimizing applications for scalability and performance. Experience with testing frameworks and implementing automated testing platforms like NUnit, JUnit, and others. Deep understanding of back-end systems using Koa, Oracle, Redis, and MongoDB. Ensuring best practices in UI/UX design and responsive design using React.js with Tailwind CSS and Material-UI. Experience & Education: Bachelor’s in Computer Science with a deep technical background in full-stack development. Over 18 years of experience in building, scaling, and optimizing full-stack web applications for enterprise-level customers. Recent Success: I’ve successfully completed 28+ projects on Upwork, earning over $50K in revenue, with a reputation for delivering scalable, high-performance ERP systems and enterprise-grade solutions on time. Skills & Expertise: Front-End Development: React.js, Redux, HTML5, CSS3, Tailwind CSS, Material-UI Back-End Development: Node.js, Express.js, Apollo, Koa, MongoDB, Redis, Oracle API Development: REST, GraphQL, Microservices Cloud: AWS (EC2, S3, Lambda, ElasticSearch, RDS, API Gateway, Elastic Beanstalk) DevOps: CI/CD pipelines (GitLab, Jenkins), Docker, Kubernetes Testing & Security: Automated testing platforms, OAuth 2.0, JWT, SSL/TLS I am seeking a long-term, full-time contract opportunity where I can bring my expertise in the MERN stack to develop complex applications, perform code reviews, and contribute to the success of your enterprise-grade projects. Let’s work together to build robust, scalable, and efficient solutions that drive business success!
    vsuc_fltilesrefresh_TrophyIcon Big Data
    REST API
    Redis
    PostgreSQL
    OpenAI API
    Tailwind CSS
    Amazon Web Services
    Database Architecture
    API
    Web Application
    MongoDB
    Node.js
    Redux
    React
    API Integration
    JavaScript
  • $50 hourly

    • 4.7/5
    • (20 jobs)
    Big Data Consultant, ETL developer, Data Engineer providing complete Big Data solutions, including data acquisition, storage, transformation, and analysis. Design, implement and deploy ETL Pipelines. I have degree in Computer System Engineering and 3 Years of experience in Data Driven Tasks specifically in Big Data Solutions. Additionally, having business exposure of banking sector and ecommerce platform. ------------- Data Engineering Skills ------------- Expertise: Hadoop, HDFS, Unix and Linux , Data Warehousing, Data Integration, Data Reconciliation, Data Consolidation, Dimensional Modeling, Shell Scripting, Web Scraping. Tools & Libraries: Advance SQL, Spark, Scala, Python, Hadoop, Hive, SSIS, Sqoop, Hive, Impala, AWS, Advance Excel, Redshift. Database: Oracle, MS SQL Server, SQLite
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Automation
    Database Programming
    SQL Server Integration Services
    MySQL
    Amazon Web Services
    ETL
    Amazon Redshift
    Data Analysis
    Amazon S3
    SQL
    Python
    ETL Pipeline
    Data Integration
    Apache Spark
  • $79 hourly

    • 4.5/5
    • (8 jobs)
    I have bandwidth for further development, training, consultancy and mentoring work. Kieran has passed 22+ Microsoft data-focused exams, many of which are Azure focused, link. This includes current Azure certification in Architecture, Fabric Analytics, Data Analysis, Data Engineering, Enterprise Data Analysis, Database Administration and Administration. Kieran is one of the most endorsed and recommended Microsoft Data Platform Consultants within the UK. He is an established trainer, mentor and public speaker on Power BI and the Microsoft Data Platform stack. Kieran continually invests time and resources to research into further optimising the way our customers can increase their business insights using their own data. This is while Kieran strives to spend each day delivering pragmatic solutions catering for the customer’s immediate needs. Kieran is also an expert in creating data analytics solutions which provide advanced data analytics based on multi-billion row record sets.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Microsoft Excel PowerPivot
    SQL Server Integration Services
    Power Query
    Data Modeling
    Microsoft Certified Professional
    Microsoft Power BI Data Visualization
    Microsoft Azure SQL Database
    Data Analysis
    Microsoft Power BI
    Business Intelligence
    Microsoft SQL Server Reporting Services
    Microsoft Power BI Development
    Databricks Platform
    Azure DevOps
    Microsoft Azure
    Transact-SQL
    SQL
  • $25 hourly

    • 4.9/5
    • (29 jobs)
    With 6+ years of experience in AWS cloud architecture, full-stack development, data engineering, and automation scripting, I specialize in designing, deploying, and optimizing high-performance, scalable solutions. My deep technical skills span across the AWS ecosystem, Python backend frameworks, JavaScript, and advanced automation strategies tailored to complex business requirements. AWS Cloud Architecture & Engineering: • AWS Certified Developer - Associate • Extensive experience in architecting solutions with AWS services: AWS Lambda, API Gateway, Amazon ECS, AWS Glue, Elastic Beanstalk, Amazon EMR, AWS CloudFormation, AWS Step Functions, Amazon S3, SQS, SNS, Kinesis, and Amazon Athena • Design and implementation of Data Lake architectures and Data Warehousing solutions using AWS Lake Formation, Redshift, and Glue Catalog • Advanced ETL orchestration and pipeline automation, optimizing data flow and performance at scale • AWS consultancy with a focus on cost optimization, security best practices, and infrastructure automation Backend Engineering: • Expertise in Python frameworks: Django, Flask, FastAPI, and Girder for microservices and REST API development • Proficient with AWS SDKs, particularly Boto3, and libraries such as NumPy, PyTorch, Scikit-Learn, and Pandas for data processing and ML integration • Implementation of asynchronous programming, API versioning, and middleware design for robust and secure backend systems DevOps & Infrastructure as Code: • Proficient in CI/CD pipelines with AWS CodePipeline, Jenkins, ArgoCD, and GitHub Actions • Expertise in Infrastructure as Code (IaC) with Terraform and AWS CloudFormation, automating environment provisioning and management • Configuration management and automated deployments ensuring high availability and minimal downtime Frontend Development: • Advanced skills in JavaScript and frameworks like React, utilizing MUI, CSS, Bootstrap, and HTML for building responsive, component-driven UI architectures • Proficient in modern JavaScript (ES6+) for client-side logic, DOM manipulation, and asynchronous data handling with Promises and async/await • Experience in state management with Redux, Context API, and integrating RESTful APIs for seamless frontend-backend communication Automation & Web Scraping: • Advanced automation skills using Scrapy, Selenium, Puppeteer, and Splash for web data extraction • Expertise in headless browsing, JavaScript rendering, CAPTCHA bypass techniques, and dynamic proxy rotation for reliable scraping solutions • Development of robust, maintainable scripts for automated data collection and integration into ETL pipelines I am passionate about solving complex technical challenges and leveraging cloud-native technologies to deliver impactful solutions. Let’s collaborate to bring your projects to life with precision and technical excellence!
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Data Scraping
    ETL Pipeline
    PostgreSQL
    Django Stack
    DevOps
    FastAPI
    Django
    Serverless Stack
    Data Engineering
    React
    CI/CD
    Amazon Web Services
    Python
  • $55 hourly

    • 4.0/5
    • (155 jobs)
    ✅ 🔻Expert-Vetted Top 1%🔻 freelancer on Upwork with 15+ years of experience ✅ Senior DBA, Developer, and Architect ✅ Senior Data Analytics and Data Engineer ✅ Business Intelligence and DWH expert ✅ DP-600 Microsoft Certified: Fabric Analytics Engineer Associate ✅ Microsoft Fabric, Synapse, Azure Data Factory, SSIS, SSRS, Power BI, Azure Databricks, PySpark. • Expert in Azure Data Factory, Synapse, SSIS, SSRS, Power BI, and Power BI Paginated. • Expert in Azure Data bricks pipelines and PySpark. • Expert in Query, and Procedure Optimization • Expert in complex T-SQL, PL\SQL coding, Procedures, Functions, Pivot, Dynamic SQL, etc. • Expert in managing, developing, and deploying SSRS report servers, and SSAS cubes. • I am experienced in both OLTP and Data warehouse environments. • Experienced in QlikSense, QlikView, SAP Hana, Oracle, MySQL, PostgreSQL, and Crystal Reports My work will be with a lifetime warranty.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    R
    Azure DevOps
    Microsoft Azure
    Microsoft Dynamics ERP
    Microsoft Azure SQL Database
    Microsoft SQL Server Reporting Services
    SSDT
    Transact-SQL
    SQL Server Integration Services
  • $25 hourly

    • 5.0/5
    • (23 jobs)
    Hello! I’m a seasoned Cloud Data Engineer and Architect with 8+ years of experience in building scalable, high-performance data solutions. I excel in designing and optimizing data pipelines, implementing ETL processes, and leveraging cloud technologies to transform raw data into actionable insights. My Expertise: Azure Data Engineering: Proficient with Azure Data Factory, Azure Synapse, Azure Data Lake, Databricks, and Synapse for end-to-end data solutions. AWS Data Engineering: Skilled in AWS S3, Lambda, Glue, Athena, and Redshift for cloud-native data workflows. ETL Development: Expert in ETL, data integration, and transformation processes to support complex data needs. Programming & Automation: Strong in Python and SQL for data processing, automation, and efficient workflow management. I’m committed to delivering reliable, high-quality data solutions that drive business growth. Let’s collaborate to unlock your data’s potential!
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Python Script
    Data Ingestion
    Cloud Computing
    Data Extraction
    Data Warehousing
    Data Lake
    Microsoft Azure
    PySpark
    Data Migration
    Apache Spark
    Databricks Platform
    Data Engineering
    SQL
    ETL Pipeline
  • $50 hourly

    • 5.0/5
    • (186 jobs)
    I am a professional software developer with a degree in Computer Systems Engineering. My experience of 7 years includes building everything from web applications to Artificial Intelligence-based systems with the latest technologies, mostly Python and Node JS. My history and review reflects my performance working with the top Enterprise Clients on Upwork. My communication in English is fluent, so it won't be a barrier at all. Following are the areas that I am proficient at: **** Web apps ✅ Figma/PSD to HTML ✅ Angular ✅ React JS ✅. Vue JS ✅. Django ✅ Flask ✅. FAST API ✅. HTML, CSS, Javascript, jQuery ✅. Express JS ✅. Node JS ✅ Databases (MySQL, SQLite, Postgresql, MongoDB, Firebase) ✅ Web Scraping using Selenium, Beautifulsoup, and Scrapy ✅ REST APIs/ GraphQL ✅ Unit testing using Pytest, JEST ✅. Elasticsearch **** Data Engineering ✅. Ingest data from data sources. ✅. Databases (Redshift, Bigquery, PostgreSQL, MySQL, MongoDB, etc). ✅. Build and maintain Data warehouse. ✅. Schedule and automate ETL pipelines using Airflow. ✅. Optimize queries. ✅. BI tools/dashboards **** Artificial Intelligence ✅. Langchain AI Agents and Tools ✅. LLM Prompt Engineering ✅. NLP using spaCy and NLTK ✅. Deep Learning ✅. Neural Networks ✅. Time-series Analysis ✅. Recommendation Engine **** 3rd Party APIs: ✅. Telegram ✅. Paypal, Stripe, and many other payment platforms. ✅. Instagram, Twitter, Meta ✅. Twilio, Salesforce, PerfectGym ✅. Stock exchange APIs **** Deployment ✅. AWS ✅. Lambda Functions ✅. Serverless Architecture ✅. Digitalocean ✅. Heroku ✅. GCP ✅. Docker As a top-rated seller, I always try to meet the client's satisfaction with my top-quality work. Feel free to reach out anytime.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Data Scraping
    RESTful API
    Web Development
    Data Management
    Django
    Node.js
    GraphQL
    Database Maintenance
    Automated Deployment Pipeline
    React
    ETL Pipeline
    Flask
    Data Science
    Machine Learning
    Python
  • $40 hourly

    • 4.7/5
    • (57 jobs)
    Greetings! I'm Adil, a seasoned Data Scientist having a Master's degree in Computing with over 15 years under my belt, I've perfected the art of converting intricate data into strategic insights. My toolkit is packed with an array of tools and technologies, each mastered to enhance business decision-making. From the core depths of SQL databases to the dynamics of data visualization tools, my proficiency spans wide. Tools & Technologies I'm proficient In: - SQL Databases: MySQL, Postgres, Big Query, SQL Server and AWS Redshift - Visualization Tools: Google Data Studio/ Looker, Power BI, Tableau, Grafana, Apache Superset - ETL: Airbyte OSS, Custom ETL, all sorts of 3rd party data ingestion platforms - Programming: Python (for data manipulation and analysis) and JavaScript - Office Tools: MS Excel, Google Sheets - Ad Platforms: Facebook Ads, Google Ads, Youtube Ads, Twitter Ads, LinkedIn Ads, TikTok Ads - Social Media Analytics: Meta, Twitter, LinkedIn, Youtube - CRM Platforms: GoHighLevel, Close.io, HubSpot, Salesforce, Intercom, Notion - Ecommerce: Shopify, Amazon Sellar Central, eBay - Communication Platforms: CallRail, AirCall, Front, Slack, Asana - Data Pipelines: Fivetran, Supermetrics, Power My Analytics, Syncwith, and more - Web Platforms: WordPress (database & analytics) - Google Suite: Google Forms, Search Console, Google Analytics GA4, Tag Manager Data Analysis & Dashboard Creation: My expertise doesn't just stop at knowing tools – it's about leveraging them to their fullest potential. I excel in dissecting vast amounts of data, spotting trends, patterns, and anomalies. With my profound knowledge in visualization tools, I've assisted numerous businesses in creating intuitive, interactive dashboards. These not only depict data but narrate a story, making it easier for stakeholders to make informed decisions. Availability & Communication: I prioritize clear, timely communication, ensuring my clients are always in the loop. My dedication means I'm readily available for discussions, brainstorming sessions, or any spontaneous data emergencies. The tech world never sleeps, and while I do value my rest, I'm committed to being there when my clients need me most. Thank you for considering me for the assignment. I'm genuinely enthusiastic about the prospect of working with you. Leveraging data for meaningful insights and impactful decision-making is my passion, and I'm eager to bring that dedication to your project. I look forward to potentially collaborating. Best regards. Adil
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Data Visualization
    Microsoft Power BI
    Business Intelligence
    Looker Studio
    Data Analysis
    Looker
    Grafana
    Excel Formula
    BigQuery
    Query Development
    Database Design
    Microsoft Excel
    MySQL
    Python
    Google Sheets
  • $44 hourly

    • 4.9/5
    • (38 jobs)
    If you're considering a development project, talk to our team. We'll walk you through a brainstorming session where we can scope your project and explain how ... _Entrepreneurs: Have a big idea but don't have an engineering team in place already? Let us be your one-stop-shop. We'll work together with you to evaluate your needs, develop a game-plan and create a product you can be proud of. _Startups: Need to augment your team with highly specialized members who can integrate seamlessly with you? We can provide an extremely talented, focused team that will work alongside you for incredible results _Enterprises: Can't find the internal resources for a new project or request? Let us help. We understand the scalability and security concerns that come with an enterprise system. -Experience in coding/development of front-end as well as back-end technologies. -Expertise in designing and developing applications using MVC, ASP.NET, C#, VB.NET, SQL SERVER 2005/2008/2012, HTML 4/5, Java Script, Win Forms, Entity Framework & Angular.JS. Good experience in XML and XSLT transformation. -Expertise in using Language Integrated Query (LINQ) for data manipulation. Good experience in development of reports using Crystal Reports, SSRS, and Data Reports. -Experience in the complete life cycle of project development (SDLC) including System Analysis, Design, Development, Testing and Deployment. -Proficient in Model-View-Controller (MVC) architectures using Rails framework. -Pervasive experience in implementing agile development methodology and scrum for the project. -Developed well-tested, readable, reusable UI interface using Ruby, JavaScript, HTML and CSS on both Windows and Linux systems. -Experience in implementing Rails Migrations
    vsuc_fltilesrefresh_TrophyIcon Big Data
    iOS Development
    Android
    AWS IoT Core
    Swift
    Node.js
    Ruby on Rails
    Machine Learning
    React
    OpenCV
    GPT-3
    ArcGIS
    AngularJS
    React Native
    C++
    Java
  • $120 hourly

    • 5.0/5
    • (48 jobs)
    Tableau Visionary (2020, 2021, and 2022) for Excellence in Teaching, Mastery of the Platform, and Collaborator. I have worked in Business Intelligence, Data Management and Digital Transformation since 2004 and dedicated the last seven years to help people get the most out of their Tableau investments; I can assist you with all aspects of Tableau from developing dashboards, administrating and setting up your enterprise infrastructure, to developing customer Extensions or other technical integrations. If you require support in your projects, do get in touch.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Project Management
    Data Science
    Stakeholder Management
    Data Modeling
    Data Warehousing
    Business Intelligence
    Data Visualization
    API Integration
    SQL
    Tableau
    Data Analysis
  • $55 hourly

    • 4.9/5
    • (33 jobs)
    I am an entrepreneur and consultant for over 18 years with expertise in following platforms Analytics: GA4, Mixpanel, Amplitude, Heap Analytics CDP / Pipelines: Segment, Rudderstack, mParticle Visualization: Looker Studio, Looker Enterprise I help digital products set up comprehensive analytics systems. I work closely with teams and map their KPIs onto these tools to make it most effective. I have created a complete analytics suite that can easily scale to over 10 Billion events per month. If you have goals like - Analytics Implementation - GA4 Migration/setup - Conversion analysis - Retention analysis - Attribution analysis - Feature adoption and friction analysis - Goal events for users like attaching a card etc. - New feature release impact - A/B testing I can help with - Analytics Integration - KPI definitions and data tracking - CDP implementation with Segment and Rudderstack - Visualization with tools like looker, Looker Data Studio, Klipfolio etc. - Connectors like Stitch, Fivetran. - Setting up reports on Amplitude, Mix-panel, Fibotalk, and GA4 - Implementation Architecture
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Marketing Analytics
    Amplitude
    Product Analytics
    Data Extraction
    Data Segmentation
    Google Analytics API
    ETL
    Mixpanel
    Google Analytics
  • $35 hourly

    • 4.7/5
    • (20 jobs)
    ***********************I shall either find a way or make it one******************** I'm an Engineer in Operational Research , I've got many skills and expertise that will allow me to achieve perfectly all the projects and missions. I have advanced knowledge's in: Vba Excel Optimization Queuing Theory Linear Programming Economics modeling, Data Mining: Factor analysis, Principal Component Analysis, Regression (Simple, Multiple, logistic, hierarchical, Poisson), Anova, Clustering, Hierarchical Clustering... I master Lingo, Ampl, Spss, Stata, R, Eviews, I'll provide you perfect reporting using MsWord. Also I have a huge experience / Knowledge with creating software for scraping/extracting data from web site with VBNET
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Marketing Analytics
    Machine Learning
    API Integration
    Django
    Stata
    R Shiny
    Statistics
    Statistical Programming
    Data Scraping
    Python
    R
    pandas
    Data Mining
  • $35 hourly

    • 5.0/5
    • (7 jobs)
    I am a data engineer expert with over than 5 years experience in data ingestion, integration and manipulation. Till date, I have done many projects in data engineering and big data. I worked on business analytics and telco analytics, i used multy data platforms and framework such as Cloudera data platform, Nifi, R studio, Spark, Hadoop, Kafka ... If this is what you want, then get in touch with me
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Cloud Engineering
    Cloudera
    Apache Hadoop
    Data Warehousing
    Apache NiFi
    Linux
    Apache Spark
    Data Lake
    Data Analysis
    SQL
    Business Intelligence
    Scala
    Apache Hive
    Python
  • $50 hourly

    • 5.0/5
    • (80 jobs)
    I have 10 years working experience and I'm confident about my skill in these roles: - Big data engineer. - Web developer. - Backend engineer. - DebOps Most of my freelance project is related to Piwik frameworks now is Matomo Open Analytics Platform As a big data engineer: - I built many analytics systems that be able to serve millions of pageview a month with Hadoop and Kafka and Spark. - I combined Redash and BigQuery to build report dashboard that enable BI team to bring out important decisions for business. - I customized Piwik to get over beyond the role of web analytics. We might use it to track everything from User behavior, realtime monitoring or system performance. - My task is including: + Install Piwik on cloud. + Optimize current Piwik. + Debug of tracking problem + Writing new plugin and widget that display many kind of charts and data. + Integrate Piwik API with other website to provide own control report & dashboard. As a backend Engineer: - I worked with Django rest framework running on Google App Engine. - I'm be able to use Datastore and ndb for financial transaction. - Using Python and Go to build micro services. - Gain deep knowledge on Python, Django and Google App Engine. As a web Developer: - I'm very excited to play with opensource. I could develop system based on large open source project like Piwik, Yii, and Laravel and Zend. It's take time for understanding a platform, but after that, I could do everything with it, include extending, writing plugin, customizing core or even rewrite it as my own way. - My favorite PHP framework is Yii because of fast and clean. I also worked with couponic and pinnect - uniprogy framework (Based on Yii). As a data engineer: - Doing ETL for many projects. - Handle traffic of a lot of traffic 40 millions pageviews/ 60GB a day. - Checking fake click by fuzzy logic algorithm Dempster-Shafer theory of evidence. - Parsing log into MySQL, Postgre, Hadoop, BigQuery. - Web Analytics for website, ecommerce, online newspaper and advertising network. - Batch & Real-time processing data to bring out report dashboard. - Calculate credit score. As a DevOps: - I could also deal with Linux system. Ubuntu is my favorite operating system. I could setup and maintain servers, whatever it running on debian, centos, Docker, Amazon EC2 or Google Cloud Platform. - Use CircleCI/Jenkins to manage and run tests and perform continuous integration. - I could work with linux shell script or python script to do daily task or background job processing on Linux server. - Dockerize server based service to miro-service that able to run on Kubernetes If you're interested in me, I could help you on your projects and contribute to your successful.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Python Script
    Piwik PRO
    CI/CD
    Linux System Administration
    Google App Engine
    Analytics
    Google Cloud Platform
    RESTful API
    Python
    PHP
    Amazon Web Services
    Django
  • $40 hourly

    • 5.0/5
    • (4 jobs)
    Certified Data Engineer with over 7 years of expertise in Data Warehousing, ETL, Big Data, and Data Visualization. I have a proven record of delivering high-quality, on-time projects across industries like healthcare, e-commerce, and real estate. My broad experience and technical proficiency allow me to design tailored data solutions that align with specific business needs, helping organizations gain actionable insights and optimize operations. 🔍 𝐄𝐱𝐩𝐞𝐫𝐭𝐢𝐬𝐞: 𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫𝐢𝐧𝐠 / 𝐃𝐚𝐭𝐚 𝐖𝐚𝐫𝐞𝐡𝐨𝐮𝐬𝐢𝐧𝐠: Skilled in designing robust Enterprise Data Warehouses (EDW) using ETL tools and databases for secure, scalable data solutions. 𝐄𝐓𝐋 𝐏𝐫𝐨𝐜𝐞𝐬𝐬𝐞𝐬: Proficient in developing reliable ETL pipelines and integrating diverse data sources for quality, consistent data flow. 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 & 𝐂𝐥𝐨𝐮𝐝 𝐏𝐥𝐚𝐭𝐟𝐨𝐫𝐦𝐬: Experienced with Big Data technologies like Hadoop and cloud platforms such as GCP, Azure, and AWS, ensuring efficient, scalable data processing. 𝐃𝐚𝐭𝐚 𝐕𝐢𝐬𝐮𝐚𝐥𝐢𝐳𝐚𝐭𝐢𝐨𝐧: Adept at creating impactful dashboards using tools like Tableau, Power BI, and Looker Studio, turning complex data into actionable insights. 🔧 𝐒𝐤𝐢𝐥𝐥𝐬: 𝐃𝐚𝐭𝐚𝐛𝐚𝐬𝐞 𝐓𝐞𝐜𝐡𝐧𝐨𝐥𝐨𝐠𝐢𝐞𝐬: Vertica, MySQL, BigQuery, Redshift, IBM DB2, Neo4J, SQL Server 𝐄𝐓𝐋 & 𝐃𝐚𝐭𝐚 𝐈𝐧𝐠𝐞𝐬𝐭𝐢𝐨𝐧 𝐓𝐨𝐨𝐥𝐬: Talend Open Studio, IBM InfoSphere DataStage, Pentaho, Airflow, Data Build Tool (dbt), Kafka, Spark, AWS Glue, Azure Data Factory, Google Cloud Dataflow, Stitch, Fivetran, Howo 𝐁𝐈 𝐓𝐨𝐨𝐥𝐬:Tableau, Power BI, Looker Studio 𝐋𝐚𝐧𝐠𝐮𝐚𝐠𝐞𝐬: SQL, Python 𝐂𝐥𝐨𝐮𝐝 & 𝐈𝐧𝐭𝐞𝐠𝐫𝐚𝐭𝐢𝐨𝐧: GCP, AWS, Azure, API Integration (Screaming Frog, AWR, Google Ads, Citrio Ads, Hubspot, Facebook, Apollo) and analytics tools like GA4, Google Search Console) 📚 𝐂𝐞𝐫𝐭𝐢𝐟𝐢𝐜𝐚𝐭𝐢𝐨𝐧𝐬: 𝟏. Vertica Certified Professional Essentials 9.x 𝟐. IBM DataStage V11.5.x 𝟑. Microsoft Power BI Data Analyst (PL-300) 𝟒. Vertica Certified Professional Essentials 9.x 𝟓. GCP Professional Data Engineer 𝟔. IBM DataStage V11.5.x 💡 𝐖𝐡𝐲 𝐂𝐨𝐥𝐥𝐚𝐛𝐨𝐫𝐚𝐭𝐞 𝐰𝐢𝐭𝐡 𝐌𝐞? 𝐓𝐞𝐜𝐡𝐧𝐢𝐜𝐚𝐥 𝐏𝐫𝐨𝐟𝐢𝐜𝐢𝐞𝐧𝐜𝐲: I leverage the latest in data engineering and visualization tools to ensure optimal project performance. 𝐐𝐮𝐚𝐥𝐢𝐭𝐲 𝐖𝐨𝐫𝐤 & 𝐄𝐱𝐜𝐞𝐥𝐥𝐞𝐧𝐜𝐞: Committed to delivering high-quality, dependable solutions that consistently exceed expectations and support sustainable growth. 𝐂𝐫𝐨𝐬𝐬-𝐈𝐧𝐝𝐮𝐬𝐭𝐫𝐲 𝐄𝐱𝐩𝐞𝐫𝐭𝐢𝐬𝐞: My experience spans multiple industries, allowing me to customize solutions to fit diverse business needs. Let’s connect and explore how I can help you achieve your data goals!
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Python
    dbt
    Google Cloud Platform
    Vertica
    Apache Hadoop
    Talend Data Integration
    Apache Hive
    Business Intelligence
    SQL
    Tableau
  • $85 hourly

    • 5.0/5
    • (22 jobs)
    I bring a strong background in data management and analytics to the table, with proficiency in SQL (MySQL, PostgreSQL, MS), NoSQL (JSON, MongoDB, DynamoDB), and expertise in automating and managing data pipelines using tools like Python, Hadoop, and Airflow. My experience extends to various visualization and BI tools, including Tableau, PowerBI, Google Data Studio, and Looker, enabling me to transform complex datasets into actionable insights. I have experience writing and managing Python backends (using Flask and Django) and front-end javascript applications (React, Angular, Vue.js). In addition to my front and backend skills I have a keen interest and proficiency in AI technologies, including working with natural language processing (NLP) models like ChatGPT and Langchain. This AI expertise allows me to harness the power of advanced language models for text analysis, chatbot development, and other AI-driven applications. Whether it's optimizing data pipelines or leveraging AI for enhanced data analysis, I'm committed to working collaboratively with stakeholders to ensure speed, consistency, and reliability in data solutions throughout the entire data lifecycle.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Flask
    Django
    React
    MySQL Programming
    Google Cloud Platform
    BigQuery
    Data Analysis
    Data Visualization
    Tableau
    Looker
    Business Intelligence
    Microsoft SQL Server
    PostgreSQL
    Python
    MySQL
  • $20 hourly

    • 4.8/5
    • (109 jobs)
    I am PhD scholar in Statistics. I have ten years of experience as Statistical Analyst. I work efficiently and without errors. My objective is to work with honor and best result to satisfy my client.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Survey Design
    Tutoring
    Mathematics
    Probability Theory
    Quantitative Analysis
    Logistic Regression
    Linear Regression
    Data Science
    Statistical Analysis
    Hypothesis Testing
    Statistics
    R
    Microsoft Excel
  • $35 hourly

    • 4.7/5
    • (17 jobs)
    Experienced Elasticsearch Engineer with 7+ years in designing, implementing, and maintaining large-scale Elasticsearch clusters. Proficient in the entire ELK Stack (Elasticsearch, Kibana, Logstash), ensuring seamless integration and optimization. Summary of Experience: Elasticsearch: ⦿ Managed Elasticsearch Cluster with up to 300GB of RAM, 35TB of storage, and 120 CPU cores. ⦿ Designed, implemented Elasticsearch clusters for multiple environments. ⦿ Proficient on capacity planning to ensure clusters meet current and future demands. ⦿ Optimized Elasticsearch performance through index tuning, sharding, replication. ⦿ Experienced in securing Elasticsearch nodes by encrypting communications. ⦿ Proficient in Snapshot and restore operations. ⦿ Wrote advanced Elasticsearch queries using Query DSL for searches. ⦿ Utilized Aggregations to analyze and summarize data within Elasticsearch. ⦿ SIEM Logstash: Expert in data ingestion and integration with Elasticsearch and Logstash, handling large datasets from various sources such as CSV, logs, Cassandra, JSON, MongoDB, Kafka, RabbitMQ, and SQL Server. Kibana: Created diverse charts and visualizations in Kibana, including line, bar, pie, and area charts. Designed complex aggregation-based visualizations with Kibana Lens and built dashboards to monitor real-time data and metrics. Implemented time series visualizations for analyzing temporal trends. Beats and Other Tools: Experienced in using Beats (Filebeat, Metricbeat, Winlogbeat, Packetbeat) for log collection and parsing. Integrated monitoring tools like Prometheus for Linux metrics and set up alerts in Grafana. Worked with AWS S3 for snapshots and restores, Prometheus for server logs, NGINX for Kibana user management, Apache NiFi, Graylog for clusters and pipelines, OpenSearch for cluster management, and Enterprise Search for integrating Confluence and building search UI applications. 𝗧𝗲𝗰𝗵𝗻𝗶𝗰𝗮𝗹 𝗪𝗿𝗶𝘁𝗲𝗿 𝗳𝗼𝗿 𝗢𝗽𝘀𝘁𝗲𝗿.𝗰𝗼𝗺: 𝗔𝘂𝘁𝗵𝗼𝗿𝗲𝗱 𝗜𝗻-𝗗𝗲𝗽𝘁𝗵 𝗔𝗿𝘁𝗶𝗰𝗹𝗲𝘀 𝗼𝗻 𝗘𝗹𝗮𝘀𝘁𝗶𝗰𝘀𝗲𝗮𝗿𝗰𝗵 𝗮𝗻𝗱 𝗥𝗲𝗹𝗮𝘁𝗲𝗱 𝗧𝗲𝗰𝗵𝗻𝗼𝗹𝗼𝗴𝗶𝗲𝘀: ⦿ How to Migrate Data between Different Versions of Elasticsearch & Between Clusters. ⦿ Elasticsearch Version Upgrades – Using Feature Migration APIs to Avoid Deprecation Issues. ⦿ Missing shards in Elasticsearch. ⦿ Elasticsearch Rolling Restart: How to Perform Rolling Restarts. ⦿ How to Upgrade Versions in Elasticsearch
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Linux System Administration
    Logstash
    Visualization
    CentOS
    Amazon S3
    ELK Stack
    Article Writing
    Linux
    Elasticsearch
    Red Hat Enterprise Linux
    Technical Writing
    Ubuntu
    Kibana
  • Want to browse more freelancers?
    Sign up

How it works

1. Post a job

Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.

2. Talent comes to you

Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.

3. Collaborate easily

Use Upwork to chat or video call, share files, and track project progress right from the app.

4. Payment simplified

Receive invoices and make payments through Upwork. Only pay for work you authorize.

Trusted by

How do I hire a Big Data Engineer on Upwork?

You can hire a Big Data Engineer on Upwork in four simple steps:

  • Create a job post tailored to your Big Data Engineer project scope. We’ll walk you through the process step by step.
  • Browse top Big Data Engineer talent on Upwork and invite them to your project.
  • Once the proposals start flowing in, create a shortlist of top Big Data Engineer profiles and interview.
  • Hire the right Big Data Engineer for your project from Upwork, the world’s largest work marketplace.

At Upwork, we believe talent staffing should be easy.

How much does it cost to hire a Big Data Engineer?

Rates charged by Big Data Engineers on Upwork can vary with a number of factors including experience, location, and market conditions. See hourly rates for in-demand skills on Upwork.

Why hire a Big Data Engineer on Upwork?

As the world’s work marketplace, we connect highly-skilled freelance Big Data Engineers and businesses and help them build trusted, long-term relationships so they can achieve more together. Let us help you build the dream Big Data Engineer team you need to succeed.

Can I hire a Big Data Engineer within 24 hours on Upwork?

Depending on availability and the quality of your job post, it’s entirely possible to sign up for Upwork and receive Big Data Engineer proposals within 24 hours of posting a job description.

Schedule a call

Looking to hire for long-term or full-time assignments? See how Full-time hiring on Upwork simplifies the process.