Upwork home
Sign up
Secondary

Hire the best Big Data Engineers in the United Kingdom

Check out Big Data Engineers in the United Kingdom with the skills you need for your next job.
Get started
  • $100 hourly
    • 5.0/5
    • (7 jobs)
    As a Senior Data Analyst with over 9 years of hands-on experience, I bring a profound passion for leveraging data to solve complex business challenges and drive measurable results. Based in London, UK, I've honed my expertise at leading global organizations like BMW and Amazon, where I consistently transformed raw data into critical insights, directly impacting decision-making and operational efficiency. My Upwork success, including over $50,000 earned and high client satisfaction, further solidifies my ability to deliver exceptional value. I specialise in designing and implementing robust Business Intelligence (BI) and Cloud Data Solutions. My work isn't just about presenting numbers, it's about crafting a clear, compelling data narrative that empowers stakeholders at all levels to understand trends, identify opportunities, and make data-driven decisions that propel growth. What I Offer to Your Business: Actionable Data Visualization & Dashboarding: I create intuitive, visually engaging, and highly functional dashboards using Tableau, Power BI, and AWS QuickSight. These reports consolidate large datasets, making complex information accessible and leading to improved decision-making effectiveness (e.g., increased 20% at BMW). I ensure your data tells a story that resonates. End-to-End SQL & Data Modeling: With advanced SQL proficiency, I develop, optimize, and maintain robust relational databases and data models. I'm adept at crafting complex queries in environments like AWS Redshift and Athena, leveraging methodologies like Kimball to enhance analytical capabilities and ensure data integrity. Cloud Data Migration & Architecture: I champion the successful migration and assimilation of data into modern Cloud Data Warehouses. My experience includes working with AWS Web Services (Redshift, Athena, QuickSight), Azure, and Snowflake, improving data accessibility and retrieval speed by up to 30%. I've also formulated data warehouse structures within Hadoop. Process Automation & Efficiency: I excel at analysing critical business processes and automating repetitive operational tasks using advanced SQL solutions (triggers, jobs) and Python. This expertise has consistently increased workforce productivity (e.g., 15% at Amazon) and created significant process efficiencies. Data Governance & Quality Assurance: I implement rigorous data governance standards and controls, ensuring data accuracy, integrity, and security for reliable BI reports. My focus on data quality means you can trust the insights derived for strategic planning. I also conduct thorough User Acceptance Testing (UAT) to ensure solutions meet functional requirements. Strategic Business & Stakeholder Collaboration: I partner closely with key stakeholders, from senior leadership to non-technical teams, to elicit, clarify, and prioritize requirements. My strong communication skills enable me to translate complex data findings into clear, actionable insights, fostering consensus and driving project success. My Core Technical Capabilities: - Business Intelligence & Visualization: Power BI, Tableau, AWS QuickSight, Zoho Analytics - Database & SQL: Advanced SQL, AWS Redshift, AWS Athena, Oracle, Other cloud & relational databases - Cloud Platforms: Amazon Web Services (AWS), Azure, Snowflake, Google Cloud - Automation: Python (data analysis, automation), VBA (Excel) - Project Management & Collaboration: JIRA, Confluence, GIT, Agile SDLC - Data Governance & Quality: Data modeling, data cleaning, data validation, data integrity Why Partner With Me? My enthusiasm for data innovation drives me to continuously explore new solutions and refine existing processes. I take immense pride in not only meeting but consistently exceeding client expectations by delivering high-quality, insightful data solutions that are both timely and incredibly effective. I am committed to understanding your unique challenges and translating them into data strategies that yield tangible business improvements. Let's collaborate to unlock the full potential of your data. I am confident that my blend of experience and client-centric approach will make a significant impact on your next project. Ready to transform your data into your most strategic asset? Send me a message today to discuss how I can help you achieve your business goals and drive impactful results!
    Featured Skill Big Data
    Relational Database
    Business Intelligence
    Microsoft Azure
    Google Cloud Platform
    Data Visualization
    Data Modeling
    Amazon QuickSight
    Python
    Automation
    Microsoft Power BI Data Visualization
    Microsoft Excel
    SQL
    Tableau
    Data Analysis
  • $120 hourly
    • 5.0/5
    • (3 jobs)
    World-class expert in clouds, storages, data platforms, and high-performance systems, having led teams and core projects at AWS S3 and Apple. US Inventor. Lately, I have been focusing primarily on Clouds, Data Platforms & Data Governance, but fluent in the entire big data stack, including DevOps methologies, high-performance JVM installations (incl Spring), databases and Data Science. I emphasize reliability, clearly written processes, and agile turnaround with all stakeholders. I am now bootstrapping my own B2B startup, where I handle CustDev, Product Management, GTM, complex UX, enterprise search with AI and everything else. I am not that proficient in these areas, but I am learning something new every day. As a hedge against startup turbulence, I am happy to share my core competencies with companies through Upwork!
    Featured Skill Big Data
    Artificial Intelligence
    Cloud Architecture
    Data Analysis
    Apache Hadoop
    Amazon S3
    Distributed Computing
    AI Bot
    Python
    Apache Spark
    Web Application
    Java
    Amazon Web Services
  • $45 hourly
    • 4.6/5
    • (25 jobs)
    Cloud Infrastructure | CI/CD Automation | Scalable DevSecOps Solutions AWS & Azure Architect | Expert in Multi-Cloud Systems | 20+ Years in IT Hi, I’m Mohammed – Your DevOps & Cloud Infrastructure Expert! I help businesses design, build, and scale secure, resilient, and automated cloud environments using AWS, Kubernetes, Terraform, and modern DevOps practices. With 8+ years in Cloud Engineering and over 20 years in IT, I bring deep hands-on experience with infrastructure architecture, CI/CD pipelines, and full-stack delivery across AWS, Azure, and GCP. Whether you're launching a SaaS platform, migrating to the cloud, or improving your DevSecOps architecture — I’ll help you execute faster, safer, and smarter. 𝗠𝘆 𝗘𝘅𝗽𝗲𝗿𝘁𝗶𝘀𝗲 & 𝗖𝗼𝗿𝗲 𝗦𝗸𝗶𝗹𝗹𝘀 ✅ AWS, GCP, Azure – Cloud architecture, automation, & cost optimization ✅ DevOps & DevSecOps – Security-focused pipelines & cloud practices ✅ CI/CD Pipelines – Jenkins, GitHub Actions, GitLab CI, CircleCI ✅ Containerization – Docker, Kubernetes, Helm, EKS, AKS, ECS, Fargate ✅ Infrastructure as Code – Terraform, CloudFormation, Ansible ✅ Full-Stack Delivery – MERN / LAMP stacks, serverless, microservices ✅ Monitoring & Logging – Prometheus, Grafana, EFK, CloudWatch ✅ Automation & Scripting – Bash, Python ✅ Data Infrastructure – Airflow, Data Lakes, Redshift, Glue, Athena ✅ Linux & Open Source – Ubuntu, RedHat, SUSE, CentOS 𝗧𝗲𝗰𝗵 𝗦𝘁𝗮𝗰𝗸 & 𝗧𝗼𝗼𝗹𝘀 𝗜 𝗨𝘀𝗲 AWS | Azure | GCP | Kubernetes | Terraform | CI/CD | Jenkins | Docker | GitHub Actions Helm | Ansible | Serverless | Cloud Storage | Cloud Compute | Cloud DB | DNS | Git | Prometheus | Grafana | CloudFormation | Apache Airflow | SQL | NoSQL | NGINX | Python | Bash 𝗪𝗵𝘆 𝗪𝗼𝗿𝗸 𝗪𝗶𝘁𝗵 𝗠𝗲? ✅ Real-World Expertise – 22+ years in IT, 8+ years in DevOps & Cloud ✅ Scalability & Security – Architecture built to grow and protect ✅ Agile Delivery – Daily updates, full transparency, team integration ✅ Proven Processes – Best practices in CI/CD, IAC, monitoring & automation ✅ Client-First Mindset – I treat every project like it's my own 𝗠𝘆 𝗣𝗿𝗼𝗰𝗲𝘀𝘀 1️⃣ Discovery & Planning – Understanding your cloud goals & current setup 2️⃣ Architecture & Design – Blueprinting infrastructure for scale & security 3️⃣ Automation & Deployment – CI/CD pipelines, containers, serverless 4️⃣ Testing & Monitoring – Ensuring performance, uptime, and security 5️⃣ Support & Optimization – Post-deployment tuning & cloud cost control Let’s future-proof your cloud infrastructure together. Whether you're starting fresh or scaling up, I’m here to help you build it right. 𝗛𝗶𝗿𝗲 𝗠𝗲 𝗡𝗼𝘄 | Let’s Discuss Your Project 𝗦𝗽𝗲𝗰𝗶𝗮𝗹𝗶𝘀𝘁𝘀: AWS & Azure Solutions Architect | DevOps Engineer | Kubernetes Specialist | CI/CD Pipeline Expert | Infrastructure Automation | Terraform & CloudFormation | Multi-Cloud Systems | Docker & Containerization | Monitoring & Logging | SaaS Infrastructure | Agile Cloud Delivery
    Featured Skill Big Data
    Infrastructure Management
    SaaS
    Containerization
    Microsoft Azure
    Azure DevOps
    Terraform
    Amazon Web Services
    Computing & Networking
    Security Infrastructure
    Kubernetes
    Docker
    AWS CloudFormation
    DevOps
    Linux System Administration
  • $40 hourly
    • 5.0/5
    • (164 jobs)
    I am an Accountant, Financial Modeller, and Automation Expert for Windows & MAC (Excel & Access, Outlook, PowerPoint) primarily using VBA, SQL, Google Sheets, Slides & Docs, and Python. I have produced hundreds of automated spreadsheets, databases, and IT solutions for clients over the years since 2005. I've been a professional Excel Financial Modeller and VBA Developer since 2005, working with numerous accountants and actuaries to produce mainly VBA automation tools and integrated financial models. I have also written a number of business plans for start-ups over the years and secured funding for them. In 2009 I produced my own Excel-based financial forecasting software (FD4Cast) which allows users to quickly build dynamic integrated financial models driven by VBA, and which got ICAEW approval as an accredited software platform. Since then I have built many dynamic, customised models for the Construction, Healthcare, FMCG, Automotive, Entertainment, and Financial sectors, but also completed many varied (non-financial) automation solutions for clients where the needs have been complex. I work well under minimal supervision and I always provide excellent support for previous projects where needs may have changed and modifications required.
    Featured Skill Big Data
    Apache Hadoop
    Accounting
    Hive Technology
    Financial Modeling
    MySQL Programming
    Accounting Software
    MySQL
    Microsoft Excel
    SQL
    Scala
    R
  • $100 hourly
    • 5.0/5
    • (15 jobs)
    I have over 15 years of programming experience, and graduated with a first-class degree in computer science from a well-known university in the UK. I worked as a database administrator and software engineer for the government, and in the online retail industry. I feel that my strengths are in communicating with clients to understand their needs and help them to nail down the requirements for their project, and in creating cleanly architectured systems which are painless to operate and maintain. I specialise in developing back-end systems and full-stack web-applications, and have independently developed tools used for purposes such as data integration, finance, CRM and reporting/analysis. I also have considerable experience working with databases, big-data and cloud systems. Additionally, I have worked for many years on video games and Android applications, acquiring experience in computer graphics and mobile application development. I am currently running my own independent game development studio.
    Featured Skill Big Data
    Game Development
    Database Administration
    App Development
    Cloud Computing
    Web Development
    Scripting
    Database Programming
    SQL
    Android
  • $150 hourly
    • 3.0/5
    • (4 jobs)
    I have multiple degrees in Data Science related topics and over 7 years industry experience starting in telecoms R&D applying machine learning and statistics on small and large scale data sets to create and use data driven machine learning models of the UK broadband access network. In 2017 I was awarded "Best Application Paper" at the British Computing Society SGAI conference for my work on 'Cable Belief Networks'. I have both automated and ad hoc experience in data extraction, cleansing, and processing using mainly Python and SQL processes in both small scale file based or using database systems (e.g. Oracle, PostgreSQL) and big data platforms (e.g. Hadoop). My experience includes automating data ETL pipelines and cleansing from a variety of data sources and usage of Hive/Impala/MapReduce/Spark processes to create implementations of statistical analysis and ML models. Extensive experience with the Python data science ecosystem libraries such as NumPy, SciPy, Pandas, Scikit-learn, Keras/TensorFlow, and visualization of data using Matplotlib. Having worked on projects with many non-technical people I am also experienced in explaining data science concepts and presenting work outputs with a focus on key points and relevance to business goals.
    Featured Skill Big Data
    Data Management
    Automation
    Analytics
    Statistics
    Data Science
    Machine Learning
    Data Extraction
    Data Scraping
    Python
  • $45 hourly
    • 4.3/5
    • (14 jobs)
    If you're in search of advanced PPC campaigns, in-depth analytics or even expertise in paid and organic social, we should have a conversation. I bring to the table leadership experience from MediaCom and Zoro.co.uk, as well as hands-on roles at Wayfair and Flipdish. While my specialism lies in Google Ads, my tenure as a Facebook Business Support representative has given me a nuanced understanding of paid social. Across a range of sectors, including B2B, film, cosmetics, furniture and MRO, I've consistently delivered positive ROI via Google and Meta Ads. Specifically, one of my B2B clients, in a highly niched-down, hard to advertise in industry, saw an ROI of 12.7x, and another B2B client in the cosmetics industry saw a cost per lead of <£10, at a high volume. My technical skill set is comprehensive, featuring Python, Google Apps Script, SQL, SA360 and BigQuery, all of which enable me to automate and optimise PPC management effectively. When it comes to data, my approach is holistic. I employ Google Analytics and Google Tag Manager to ensure a complete understanding of every user touchpoint from initial visit through to conversion. Moreover, I use Google Looker Studio to transform your data into compelling stories. I'm open to new opportunities and keen to elevate your digital marketing efforts. Please feel free to get in touch; together, we can accomplish your project objectives.
    Featured Skill Big Data
    Forecasting
    Client Management
    BigQuery
    Python
    Pay Per Click Advertising
    Google AdSense API
    Looker Studio
    Marketing Automation
    Search Engine Marketing Strategy
    SQL
    Paid Social
    Revenue Management
    PPC Campaign Setup & Management
    Search Engine Marketing
    Google Ads
    Campaign Reporting
    Google Analytics
  • $28 hourly
    • 5.0/5
    • (11 jobs)
    I’m a Senior Game Developer with 5+ years of experience building AAA and AA titles in Unreal Engine, Unity, and C++. During my time at Magic Media, I contributed to an AAA first-person game, focusing on multiplayer integration, performance optimization, and advanced gameplay mechanics. At Sovrun, I further honed my skills by developing an AA game and a fully blockchain-integrated Unity project, taking on server-side tasks like matchmaking and replication. Earlier, I worked at The VirtuLab, where I built a multiplayer VR simulation that added realism to team-based rescue scenarios. I hold a Master’s in Big Data Science from the University of Bradford and a Bachelor’s in Computer Science from FAST, grounding my approach in strong data-driven methodologies. I’m always eager to explore cutting-edge tech and collaborate with like-minded professionals to push the boundaries of gaming innovation.
    Featured Skill Big Data
    Game Engine
    AWS Lambda
    Game Development
    C#
    Artificial Intelligence
    Unreal Engine
    PostgreSQL
    Data Visualization
    Unity
    C++
    Data Science
    TensorFlow
    Python
    PyTorch
  • $50 hourly
    • 5.0/5
    • (2 jobs)
    As a seasoned Data Scientist and Technical Product Manager, I bring extensive experience in Financial Crime Risk and Credit Risk management, coupled with deep proficiency in Python, Spark, SAS (Base, EG, and DI Studio), Hadoop, and SQL. Transitioning into freelancing, I am eager to leverage my skills to contribute to diverse projects. While Upwork's guidelines restrict sharing direct links to external profiles, I am happy to provide a detailed portfolio from my LinkedIn upon request.
    Featured Skill Big Data
    Data Mining
    Data Science
    Fraud Detection
    Data Analysis
    PySpark
    SAS
    Credit Scoring
    Apache Hadoop
    SQL
    Python
  • $200 hourly
    • 5.0/5
    • (50 jobs)
    Tableau Visionary (2020, 2021, and 2022) for Excellence in Teaching, Mastery of the Platform, and Collaborator. I have worked in Business Intelligence, Data Management and Digital Transformation since 2004 and dedicated the last seven years to help people get the most out of their Tableau investments; I can assist you with all aspects of Tableau from developing dashboards, administrating and setting up your enterprise infrastructure, to developing customer Extensions or other technical integrations. If you require support in your projects, do get in touch.
    Featured Skill Big Data
    Project Management
    Data Science
    Stakeholder Management
    Data Modeling
    Data Warehousing
    Business Intelligence
    Data Visualization
    API Integration
    SQL
    Tableau
    Data Analysis
  • $50 hourly
    • 5.0/5
    • (1 job)
    👋 A Little About Me I’m a Data Analyst/ Engineer with 4+ years of experience helping startups and enterprises automate workflows, build modern data platforms, and turn raw data into business insights. My work spans across finance, SaaS, e-commerce, and healthcare domains. What I Do Best - Microsoft Fabric & Azure Synapse – Build unified analytics pipelines - ETL & Automation – Design & deploy scalable, data workflows, dbt and Airflow - SQL & Python Engineering – Clean, transform, and enrich large datasets - Cloud Infrastructure – Azure | AWS (Lambda, S3, Redshift) | GCP (BigQuery) - ML & AI Workflows – Scikit-learn, NLP, LLMs, OpenAI API integration 🚀 Why Work With Me? 🔹 Data-Driven Approach – I turn raw data into actionable insights that drive business success. 🔹 Automation & Efficiency – I build scalable workflows to save time and reduce manual effort. 🔹 Clear Communication – Expect timely updates and seamless collaboration. 🔹 Results-Oriented – I focus on delivering measurable value, not just reports. Client Results - Build a medallion architecture with the incremental loading which reduced manual reporting by 85% for a SaaS startup using automated Fabric pipelines - Built a debt forecasting engine for a finance app using AWS + Python + SQL - Developed a pipeline for the accounting software processing 120k rows daily and making it ready for KPI's What I can offer Clear communication - Daily updates and async - friendly Fast turnarounds - Time is passing let's build the solution asap Business focus - I just don't build pipelines I build solutions that move KPI's Let’s build something that works long after the job ends. Drop me a message and I’ll share how I can help 🚀
    Featured Skill Big Data
    Statistics
    Data Analysis
    Machine Learning
    Exploratory Data Analysis
    Artificial Intelligence
    Deep Learning
    Data Mining
    Python
    SQL
  • $100 hourly
    • 5.0/5
    • (4 jobs)
    Experienced Principal Consultant with a passion for unlocking potential from data. Strong background in data science and data engineering. Love building intelligent products. Work with all levels of stakeholders to deliver robust and novel solutions. - Experienced on full Microsoft Data Platform stack - Databricks SME - Trainer with 25 Microsoft & Databricks certifications - R and Python Expert
    Featured Skill Big Data
    Azure Cosmos DB
    Continuous Improvement
    Cloud Computing
    Education Presentation
    Databricks Platform
    Continuous Integration
    Data Lake
    CI/CD
    Education
    Microsoft Azure
  • $150 hourly
    • 5.0/5
    • (8 jobs)
    I am a programmer fluent in Python, SQL, and Cloud Technologies. I have a lot of experience working with data at scale including the design of automated pipelines and data warehouses. I have implemented self-service BI tools and designed bespoke reporting dashboards. I also have a lot of experience building automated scripts to scrape data from the internet and automate daily tasks. Completed Projects: - Data integrations with eCommerce API's (Walmart DSV, Amazon SP-API) - PDF text extraction via Python and OCR - Webapp created to interact with the text extraction script - API created to interact with the text extraction script - Fullstack Django WebApp created for a sport prediction game
    Featured Skill Big Data
    Django Stack
    Data Warehousing
    Looker
    Apache Spark
    Cloud Computing
    Apache Beam
    API
    Computing & Networking
    Apache Airflow
    Google Sheets
    Scripting
    JavaScript
    Automation
    Python
  • $40 hourly
    • 5.0/5
    • (2 jobs)
    Data-driven and detail-focused experienced Data Analyst with a strong background in analysing large datasets, creating informative reports, and providing actionable insights. Expert in machine learning and analysis tools including Python, Tableau, R, Excel, Power BI, and SQL. Track record of leading and collaborating with cross-functional teams to drive business growth and meet project goals. Hold an MSc degree in Artificial Intelligence and Data Analytics.
    Featured Skill Big Data
    Data Modeling
    Artificial Intelligence
    Data Cleaning
    SQL Programming
    Research & Development
    Project Management
    Machine Learning
    Data Visualization
    Microsoft Excel
    Data Analysis
    Statistical Analysis
    Microsoft Power BI
    Google Analytics
    Python
  • $100 hourly
    • 5.0/5
    • (7 jobs)
    I am a Principal Investigator at the University of Cambridge in Neuroscience and Metabolism with 15+ years of research experience. I have worked with companies consulting on matters including nootropic formulations, drug design, drug testing, and the writing of white papers. I also offer services in scientific writing and review of research proposals, grants, and papers in the biomedical sciences. I further advise on experimental design and data analysis. I have over a decade of experience publishing in prominent neuroscience journals including Neuron and have secured over £2.5 million in highly competitive grants and fellowships.
    Featured Skill Big Data
    Career Coaching
    Candidate Interviewing
    Writing Critique
    Writing
    MATLAB
    Publishing
    Research Paper Writing
    Genomics
    Grant Writing
    Dietetics
    Research Proposals
    Statistical Analysis
    Data Analysis
    Python
  • $55 hourly
    • 5.0/5
    • (2 jobs)
    I am a 𝗦𝗲𝗻𝗶𝗼𝗿 𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿 and Architect based in London with a proven track record of designing and building scalable, high-performance backend and data applications in the cloud. My expertise spans across AWS, Azure, and cutting-edge technologies, making me your go-to professional for complex data challenges and software solutions. I led the design of a multi-tenanted Data Platform for the 𝗟𝗼𝗻𝗱𝗼𝗻 𝗦𝘁𝗼𝗰𝗸 𝗘𝘅𝗰𝗵𝗮𝗻𝗴𝗲 𝗚𝗿𝗼𝘂𝗽, handling 100TB+ of data with optimized cost and performance. Known for implementing robust data lake architectures and delivering seamless real-time data streaming solutions using tools like Kafka and Amazon Kinesis, I ensure data availability, reliability, and performance at scale. With a strong focus on automation, I bring expertise in CI/CD pipelines and infrastructure as code (IaC) for data engineering workflows. 𝙈𝙮 𝙎𝙠𝙞𝙡𝙡𝙨:- 👉 SQL 👉 Kafka 👉 Airflow 👉 Python 👉 Hadoop 👉 Snowflake 👉 AWS Glue 👉 Databricks 👉 Apache Spark 👉 Data Modeling 👉 ETL Development 👉 Data Warehousing 👉 Google Big Query 👉 Azure Data Factory 👉 Tableau & Power BI 👉 Data Lake Formation 👉 CI/CD for Data Pipelines 👉 Real-time Data Processing 👉 Infrastructure as Code (IaC) 𝙈𝙮 𝘾𝙚𝙧𝙩𝙞𝙛𝙞𝙘𝙖𝙩𝙞𝙤𝙣𝙨:- 👉 Azure Architect Expert 👉 Snowflake SnowPro-Core 👉 HashiCorp Terraform Associate 👉 AWS Solution Architect Professional If you're looking for a reliable and detail-oriented Data Engineer to transform your raw data into actionable insights, let’s connect! I’m available 24/7 to discuss your project needs and deliver results that exceed expectations. Feel free to reach out—I’d love to help bring your vision to life!
    Featured Skill Big Data
    AI Data Analytics
    Tableau
    AWS Lambda
    Microsoft Power BI
    Data Scraping
    Apache Spark
    Data Science
    ETL
    Amazon Web Services
    ETL Pipeline
    Data Analysis
    Machine Learning
    SQL
    Python
  • $40 hourly
    • 5.0/5
    • (2 jobs)
    𝗢𝗻-𝗧𝗶𝗺𝗲 𝗗𝗮𝘁𝗮 𝗦𝗰𝗶𝗲𝗻𝗰𝗲. 𝗖𝗹𝗲𝗮𝗿 𝗜𝗻𝘀𝗶𝗴𝗵𝘁𝘀. 𝗤𝘂𝗶𝗰𝗸 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝗰𝗮𝘁𝗶𝗼𝗻. 👋 Hi there! Thank you for checking out my profile. I’m a certified Data Scientist and Analyst with over 6 years of hands-on experience delivering data-driven solutions to small and medium-sized businesses. Throughout my career, I have started and completed more than 70 projects, which involve analysing large data sets and creating compelling charts, dashboards, and tables that aid decision making. Whether you're looking to visualize your KPIs, uncover trends hidden in your data, build predictive models, or streamline reporting processes—I’m here to help you make smart, data-backed decisions that move your business forward. ✅ Why Work With Me? 🎓 M.Sc. in Data Science – solid foundation in analytics, business, and mathematics 🐍 Expert in Python, Excel, Google Sheets, SQL, Tableau, Power BI 📊 Proven experience as a Data Scientist and BI Analyst 🔐 Strong understanding of data privacy & security best practices 🗣️ Transparent communication and frequent updates throughout the project ♻️ Unlimited revisions – your satisfaction comes first 💡 I focus on impact, not just analysis—I aim to bring measurable value to your organization. 💼 Key Skills & Specializations 📈 Predictive Modeling & Machine Learning Tools: scikit-learn, XGBoost, TensorFlow, Excel Solver 🧠 NLP & Sentiment Analysis I analyze text data to extract insights from social media, reviews, and surveys 📊 Data Visualization & Dashboards I create interactive dashboards in Power BI and Tableau to visualize business KPIs 🛠 Data Cleaning & Automation I build pipelines to clean, transform, and load data from multiple sources. I also automate manual reporting processes using Python and Google Sheets. 📦 Big Data & Cloud Analytics I use Hadoop/Spark for large dataset processing. I am familiar with cloud tools like AWS and Google Cloud for scalable solutions 📉 Mathematical Optimization I optimize logistics and resource allocation using Solver and Linear Programming 🔧 Tools & Technologies Python | SQL | R | Excel | Google Sheets Tableau | Power BI | Alteryx | Minitab | Google Analytics 4 Hadoop | Spark | WEKA | Splunk 🌍 Industries Served include: Marketing & E-commerce, Education, Healthcare, Finance & Real Estate, Government and NGOs Let’s work together to unlock the power of your data! As a full-time Data Scientist, I'm ready to bring your project to life. I look forward to receiving your message📩.
    Featured Skill Big Data
    Dashboard
    Data Extraction
    Data Visualization
    Business Intelligence
    R
    Microsoft Excel
    Data Science
    Python
    PyTorch
    Data Modeling
    SQL
    Data Analysis
    Machine Learning
    Artificial Intelligence
  • $50 hourly
    • 5.0/5
    • (5 jobs)
    Summary ✓ Total 10+ years of experience in developing enterprise data warehousing applications. ✓ 4+ years of experience in implementing end to end Snowflake data warehouse solutions. ✓ Experience in implementing snowflake platform solutions such as RBAC, Row Access Policies, Replication etc. ✓ Experience in Data modelling techniques such as Dimensional Modelling, Data Mesh. ✓ Demonstrated expertise in crafting complex SQL queries to analyze and manipulate large datasets. ✓ Experience working on SQL and NoSQL databases. ✓ Well versed in tools like Pentaho Data Integration, Informatica. ✓ Experience working with multiple clients like Schroders, Equifax, Logitech. ✓ Good experience in converting business requirements into Technical Requirements ✓ Collaborative team player with a track record of successfully tackling intricate data challenges. ✓ Excellent communication and interpersonal skills. ✓ Experience leading a data team from onshore. Technical Skills: ✓ Database: Snowflake, SQL Server, Oracle. ✓ Cloud Technologies: AWS, Azure. ✓ Programming: Python, JavaScript ✓ Scripting: SQL, Unix ✓ Processing Tools: DBT, Pentaho, Informatica. ✓ Orchestration: Airflow ✓ Reporting: Tableau, Streamlit ✓ Collaboration: GIT, SVN ✓ Operating systems: Windows, Linux
    Featured Skill Big Data
    Apache Maven
    Pentaho
    Unix
    JavaScript
    Apache Airflow
    dbt
    Snowflake
    SQL Programming
    Data Modeling
    Data Warehousing
  • $100 hourly
    • 4.9/5
    • (18 jobs)
    Hello ! Thanks for dropping by 😊 I’m an expert with over 5 years experience in the following. 1. Data Engineering – both batch and streaming processing of data using Apache Kafka, Google Pub Sub, Apache Spark, Apache Airflow, Apache NiFi 2. Data Analysis – Experienced in carrying out various statistical analysis such as A/B testing, customer segmentation, churn prediction, time series forecasting, machine learning with tensorflow 3. Data warehousing – very experienced with Google BigQuery, PostgreSQL and Amazon Redshift 4. Data Visualisation – Expert in Google Data Studio, Klipfolio, Microsoft Power BI and intermediate user of Tableau, Mode 5. Data modelling and automation – heavy user of apache-airflow and apache-nifi, google-cloud-functions in python, amazon lambda functions. 6. Data Wrangling – I have a background as a developer using python, javascript, swift. So expert in building REST APIs or integrating with existing APIs Before data took over my life, I was a digital marketing expert for over 6 years in the areas of Search Engine Optimization (SEO), SMO, PPC, website speed optimization and email marketing. And this combination of data and business knowledge gives me the skillset to identify the KPI (key performance indicator) that is relevant to your business. This has immensely helped me in building business intelligence dashboards for varying businesses from e-commerce (Amazon, shopify), to SaaS startups to marketing agency dashboards and more. In addition I also conduct audits and make sure that clean data is generated/recorded in first place using the following 1. Auditing and setting up of Google Analytics for events and goal tracking. 2. Auditing and setting up of Google Tag Manager 3. Conversion tracking auditing and setup in Google-Ads, Facebook-ads, Bing-ads and more So do you feel like you have a challenging project? Let’s have a call Thanks, Vinay
    Featured Skill Big Data
    Data Analysis
    Looker Studio
    ETL
    Data Visualization
    Analytics
    Klipfolio
    MySQL Programming
    BigQuery
    Search Engine Optimization
    SEO Audit
    SEO Keyword Research
  • $40 hourly
    • 0.0/5
    • (0 jobs)
    I have skills and experience in web, desktop and mobile application development. I have used the following technologies: 1. Microsoft Power Apps 2. Asp.net with C# 3.Django with Python 4.Laravel with php 5. Dev Ops with Microsoft Azure 6. Big data
    Featured Skill Big Data
    Microsoft PowerApps
    Django
    Machine Learning
    Business Analysis
    Data Science
    R
    Predictive Analytics
    PHP
    C#
    Python
    ASP.NET
    Java
    ASP.NET MVC
  • $70 hourly
    • 3.0/5
    • (22 jobs)
    I am a Senior Data Engineering specialist with 9+ years of experience building data pipelines and analytic platforms that turn raw data into actionable insights. My work focuses on designing scalable ingestion, transformation, and storage solutions using technologies like Spark, Kafka, Airflow, and cloud data warehouses (Snowflake, Redshift, BigQuery). I’ve streamlined ETL processes to handle terabytes of data daily, ensuring high throughput, data integrity, and cost-efficiency. Clients benefit from timely, accurate data that powers real-time dashboards, machine learning workflows, and mission-critical reporting. I am AWS Cloud expert with DevOps specialties with me, worked on Data oriented projects and managed CI/CD pipelines, data pipelines and cloud infrastructure in IaC (Terraform/Cloudformation) for the same project. Skills: • Data Ingestion & Streaming: Kafka, AWS Kinesis, Google Pub/Sub, RabbitMQ • Big Data Processing: Apache Spark, Hadoop (HDFS, Hive, MapReduce), Databricks • ETL/ELT & Workflow Orchestration: Apache Airflow, AWS Glue, dbt, Talend • Databases & Warehouses: Snowflake, Amazon Redshift, Google BigQuery, Azure Synapse • Programming & Scripting: Python (PySpark, Pandas), SQL, Scala, Bash • Cloud Services: AWS (EMR, S3, Athena), GCP (Dataflow, BigQuery), Azure (Data Factory) • NoSQL & Storage: DynamoDB, MongoDB, Cassandra, HBase • Data Modeling & Schema Design: Star/Snowflake schemas, partitioning, indexing •BI/Visualization: Tableau, Power BI, Looker, QuickSight • Data Governance & Quality: Great Expectations, Deequ, data lineage, metadata management • Performance Optimization: Query tuning, Spark job optimization, partition pruning
    Featured Skill Big Data
    Data Analysis
    Data Science Consultation
    Database
    ETL Pipeline
    Data Migration
    ETL
    DevOps
    PostgreSQL
    Apache Spark
    Docker
    Java
    Amazon Web Services
    Python
  • $40 hourly
    • 0.0/5
    • (0 jobs)
    Senior Software and Data Engineering Consultant with over 7 years of experience delivering impactful solutions across the financial services, banking, and technology sectors. I specialize in building fullstack applications, scalable data platforms, engineering robust ETL pipelines, and integrating financial systems with a focus on quality, security, and performance. My background spans big data technologies (Apache Spark, Kafka, Databricks, AWS, GCP), cloud-native architectures, and traditional financial transaction systems (Postilion, ISO8583, ISO20022). I am passionate about financial technology, data engineering, AI/ML and cloud solutions — and actively seek roles where I can continue solving challenging problems, building scalable platforms, and delivering value through technology innovation.
    Featured Skill Big Data
    Apache Maven
    Payment Processing
    Apache Kafka
    Apache Hive
    Python
    Scala
    Apache Spark
    Java
    Android
    Amazon Web Services
  • $51 hourly
    • 4.0/5
    • (1 job)
    Who Am I? I’m a Senior Data Engineer with 6+ years of experience designing and deploying scalable data platforms, real-time pipelines, and AI-ready analytics solutions. I've worked with global enterprises like 𝐖𝐢𝐳𝐳𝐀𝐢𝐫, 𝐂𝐢𝐬𝐜𝐨, and 𝐂𝐨𝐨𝐩, as well as fast-scaling startups such as 𝐌𝐞𝐝𝐢𝐤𝐢𝐭 and 𝐁𝐫𝐨𝐲𝐚𝐥𝐢𝐯𝐢𝐧𝐠.𝐜𝐨𝐦. My focus is on building robust, fault-tolerant data systems - from ETL/ELT frameworks to real-time stream processing and fully automated cloud-native infrastructures. Services I Offer - Full-cycle ETL/ELT pipeline development (batch & streaming) - Cloud migration from CRMs, blob storage or legacy infrastructure to AWS, Azure, or GCP - Real-time data architecture design (Kafka, Spark, Event Hub) - Data Quality framework setup with automated validations and alerts - AI-ready platforms: from feature engineering to ML-triggered alerting - CRM data integrations, marketing & ad analytics - Infrastructure-as-Code deployments (Terraform, Kubernetes, CI/CD) - Interactive dashboarding, visualizations and modeling Key Project Highlights - Hadoop to AWS migration for a Fortune 500 company:: S3, EMR, Airflow, API integrations, and Terraform-based IaC - Real-time KPI platform for US telecom: Spark Structured Streaming, Kafka, Kubernetes, sub-second latency - AI-driven analytics platform (Danish retailer): medallion architecture, custom ETL builder, personalized offers, Power BI dashboard - CRM migration (Crio → Medidata): automated data transfer, schema validation, error alerts - Google Ads optimisation system: 11% cost reduction, 7% traffic increase, with GA & custom attribution modeling - WizzAir data platform POC: DBT in Azure containerized architecture, orchestrated via Data Factory, with Great Expectations for quality control Let’s Talk If you're looking for a senior data engineer who brings production-level thinking, scalable systems, and deep cloud expertise - let's chat. I can help turn your data infrastructure into a reliable growth engine. Reviews: ⭐⭐⭐⭐⭐ - Nima Sotoadeh, CEO of Broya Nick has been an incredible asset to us at Broya. His data engineering expertise is not only profound but also practically applied to real-world problems. His work has significantly contributed to the success of our projects and data pipeline creations. He is a true professional and a pleasure to work with. ⭐⭐⭐⭐⭐ - Ruslan Kravets, CEO of Medikit Working with Nick has transformed our approach to data management at Medikit. His contributions were crucial in developing an efficient and automated data management system, complemented by real-time dashboarding, which has streamlined our operations and decision-making processes. Beyond his technical expertise, Nick's commitment to excellence has played a key role in enhancing our data handling capabilities and overall operational efficiency.
    Featured Skill Big Data
    Cloud Security
    Cloud Services
    Apache Kafka
    Databricks Platform
    SQL
    Apache Spark
    ETL Pipeline
    Data Migration
    Database Optimization
    Database Architecture
    Data Visualization
    Data Quality Assessment
    Data Analytics
    Data Engineering
  • $40 hourly
    • 0.0/5
    • (0 jobs)
    Proficient Azure SQL Database and Managed Instance Support Engineer with experience in business analytics, data visualization, web development, and business reporting. Well-versed in Azure cloud networking and architecture, SQL database performance optimization, providing customer support, presentations, debugging, and teaching/knowledge transfer sessions. I have substantial experience in Azure SQL Database/SQL MI support for Microsoft as a client, for 1.5 years, where I gained extensive knowledge and expertise in Azure cloud networking and architecture, 24*7 customer support, SQL database optimization, data migration, backup-restore, and problem-solving. I have recently completed Microsoft Certified Azure Data Engineer Associate Certification Exam (DP-203) and have a strong understanding of Azure fundamentals. Prior to that, I obtained a Master of Science degree in Information Technology and Management from the University of Texas at Dallas, USA, where I got hands-on experience on academic projects on Advanced Business Analytics, Big Data, Sentiment Analysis, System Analysis, and Project Management, Statistics, Data Warehousing, Agile Project Management. Earlier, I worked as Application Development Analyst at Accenture in India for over 4 years where I gained experience in web development, including skills as follows: DotNet, C#, AngularJS, Data Management, VBA development, project deployment, MS Excel reporting, and Presentations. I am well-versed in data visualization, ETL, Python, SQL, Power BI, MS Excel, Databricks, data engineering, and Microsoft Azure Cloud technologies and customer support.
    Featured Skill Big Data
    Data Migration
    Tableau
    Microsoft Power BI Data Visualization
    Business Analysis
    Databricks Platform
    Data Engineering
    Business
    PySpark
    Data Lake
    Data Analysis
    Microsoft Azure
    R
    SQL
    Python
  • $50 hourly
    • 5.0/5
    • (1 job)
    PERSONAL PROFILE Peace Lawson is a Geology graduate with a Master's degree in Petroleum Geosciences. I transitioned into Data Analysis due to the increasing demand for Big Data experts. After completing a 12-week Digital Skills Bootcamp at Just IT, I gained proficiency in MySQL, Azure, Excel, R, Tableau, and Power BI. My foundation in data entry, attention to detail, and aptitude for analysis give me the confidence to contribute to data-driven decision-making. My passion for uncovering meaningful patterns drives me. I excel in data organization and integrity, maintaining confidentiality and security. These skills have provided me with a solid understanding of data structures, data organization, and data quality control. With my ability to uphold confidentiality and data security, I strive to support the organization's success through accurate and timely data management. Beyond technical expertise, I possess excellent communication skills both verbal and written,
    Featured Skill Big Data
    Technical Support
    Phone Communication
    Customer Service
    Tech & IT
  • $35 hourly
    • 0.0/5
    • (1 job)
    As a data analyst with a PhD in biostatistics, I excel at uncovering valuable insights from a wide range of data sources. My diverse skillset in R, Python, SQL, and Tableau allows me to deliver tailored, data-driven solutions to meet my clients' unique needs. 𝗪𝗵𝘆 𝗖𝗵𝗼𝗼𝘀𝗲 𝗠𝗲? 🛠️ I'm proficient in data cleaning, statistical modeling, machine learning, and network analysis. I have a knack for tackling complex analytical challenges with a creative and meticulous approach. 💡 My diverse skillset allows me to transform raw data into meaningful insights and visualizations. I'm skilled at identifying hidden patterns and trends. 🧹 I also pride myself on my data cleaning and organization abilities. I'll work closely with you to wrangle your data, build robust data models, and ensure everything is ready for your own analytics and algorithms. 💬 I'm an effective communicator, able to bridge the gap between data and decision-makers. My ability to explain complex topics in simple terms ensures you can confidently act on my recommendations. 𝗣𝗿𝗼𝗳𝗲𝘀𝘀𝗶𝗼𝗻𝗮𝗹 𝗘𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲 (𝘀𝗲𝗲 𝗣𝗼𝗿𝘁𝗳𝗼𝗹𝗶𝗼): • Analysed large datasets with custom-built workflows for extraction, transformation, loading and statistical data analysis. • Developed a data preprocessing pipeline to handle, impute, and analyse qPCR data affected by a large proportion of missing data (up to 60%). • Automated behaviour detection in animal groups creating an analytical suite based on supervised classification. This reduced data collection time by two orders of magnitude and enabled 4 scientific studies in preparation. 𝗔𝘀 𝘆𝗼𝘂𝗿 𝗱𝗮𝘁𝗮 𝗮𝗻𝗮𝗹𝘆𝘀𝗶𝘀 𝗽𝗮𝗿𝘁𝗻𝗲𝗿, 𝗜'𝗹𝗹 𝗹𝗲𝘃𝗲𝗿𝗮𝗴𝗲 𝗺𝘆 𝗲𝘅𝗽𝗲𝗿𝘁𝗶𝘀𝗲 𝘁𝗼: 📚 Thoroughly research your problem to implement the most adequate solutions. 🔍 Uncover hidden patterns and trends in your data (exploratory data analysis and modeling). 📊 Create easy-to-understand and insightful plots and reports. 🌟 Translate complex technical findings into clear, actionable insights. Let's collaborate to unlock the full potential of your data and propel your business forward. 🤝
    Featured Skill Big Data
    Biostatistics
    Data Analysis
    Epidemiology
    Life Science
    Research & Development
    Visualization
    Analytics
    Statistical Analysis Language
    Python
    SQL
    R
    Machine Learning
    Predictive Modeling
    Statistics
  • $150 hourly
    • 0.0/5
    • (0 jobs)
    Technical Profile * PyKX * Python * Q * FX Trading * Cash/Money Markets * Fixed Income investments * KDB+ * Java * KDB Gateway * KDB Insights platform * KDB insight Enterprise * KDB.AI * Chained Ticker Plant * Linux * RDB * HDB * Docker * MongoDB * Asset Management * Wealth Management * KX Technology * Risk Management * GitHub * Athena * Spring Boot * Microsoft SQL Server Having overall 12+ years of experience in Planning, Building, Implementation, and Integration of full-scale commercial projects in the different verticals like Financial, Retail, Insurance, Banking, High-tech, social media, Oil and Gas and Networking/Telecom. Worked on various Agile practices like TDD, BDD, pair programming, continuous Integration and Scrum. Worked on programming languages like Java, Q, PyKX, Scala, Python,Spark, Shell scripting, KDB Gateway, KDB+ tick configuration, KDB+ tick profiling, Query routing, KDB+, KX Technology, Timeseries Processing.
    Featured Skill Big Data
    dbt
    Apache Airflow
    Apache Kafka
    Apache Cassandra
    Apache HBase
    Hive
    Scala
    kdb+
    Java
    Python
    Databricks Platform
    Azure DevOps
    DevOps
    PySpark
  • Want to browse more freelancers?
    Sign up

How hiring on Upwork works

1. Post a job

Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.

2. Talent comes to you

Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.

3. Collaborate easily

Use Upwork to chat or video call, share files, and track project progress right from the app.

4. Payment simplified

Receive invoices and make payments through Upwork. Only pay for work you authorize.

Top cities for Big Data Engineers in the United Kingdom
Show more