Hire the best Big Data Engineers in England

Check out Big Data Engineers in England with the skills you need for your next job.
  • $40 hourly
    I’m a Senior Game Developer with 5+ years of experience building AAA and AA titles in Unreal Engine, Unity, and C++. During my time at Magic Media, I contributed to an AAA first-person game, focusing on multiplayer integration, performance optimization, and advanced gameplay mechanics. At Sovrun, I further honed my skills by developing an AA game and a fully blockchain-integrated Unity project, taking on server-side tasks like matchmaking and replication. Earlier, I worked at The VirtuLab, where I built a multiplayer VR simulation that added realism to team-based rescue scenarios. I hold a Master’s in Big Data Science from the University of Bradford and a Bachelor’s in Computer Science from FAST, grounding my approach in strong data-driven methodologies. I’m always eager to explore cutting-edge tech and collaborate with like-minded professionals to push the boundaries of gaming innovation.
    Featured Skill Big Data
    Game Engine
    AWS Lambda
    Game Development
    C#
    Artificial Intelligence
    Unreal Engine
    PostgreSQL
    Data Visualization
    Unity
    C++
    Data Science
    TensorFlow
    Python
    PyTorch
  • $40 hourly
    I am an Accountant, Financial Modeller, and Automation Expert for Windows & MAC (Excel & Access, Outlook, PowerPoint) primarily using VBA, SQL, Google Sheets, Slides & Docs, and Python. I have produced hundreds of automated spreadsheets, databases, and IT solutions for clients over the years since 2005. I've been a professional Excel Financial Modeller and VBA Developer since 2005, working with numerous accountants and actuaries to produce mainly VBA automation tools and integrated financial models. I have also written a number of business plans for start-ups over the years and secured funding for them. In 2009 I produced my own Excel-based financial forecasting software (FD4Cast) which allows users to quickly build dynamic integrated financial models driven by VBA, and which got ICAEW approval as an accredited software platform. Since then I have built many dynamic, customised models for the Construction, Healthcare, FMCG, Automotive, Entertainment, and Financial sectors, but also completed many varied (non-financial) automation solutions for clients where the needs have been complex. I work well under minimal supervision and I always provide excellent support for previous projects where needs may have changed and modifications required.
    Featured Skill Big Data
    Apache Hadoop
    Accounting
    Hive Technology
    Financial Modeling
    MySQL Programming
    Accounting Software
    MySQL
    Microsoft Excel
    SQL
    Scala
    R
  • $100 hourly
    I have over 15 years of programming experience, and graduated with a first-class degree in computer science from a well-known university in the UK. I worked as a database administrator and software engineer for the government, and in the online retail industry. I feel that my strengths are in communicating with clients to understand their needs and help them to nail down the requirements for their project, and in creating cleanly architectured systems which are painless to operate and maintain. I specialise in developing back-end systems and full-stack web-applications, and have independently developed tools used for purposes such as data integration, finance, CRM and reporting/analysis. I also have considerable experience working with databases, big-data and cloud systems. Additionally, I have worked for many years on video games and Android applications, acquiring experience in computer graphics and mobile application development. I am currently running my own independent game development studio.
    Featured Skill Big Data
    Game Development
    Database Administration
    App Development
    Cloud Computing
    Web Development
    Scripting
    Database Programming
    SQL
    Android
  • $25 hourly
    If you're in search of advanced PPC campaigns, in-depth analytics or even expertise in paid and organic social, we should have a conversation. I bring to the table leadership experience from MediaCom and Zoro.co.uk, as well as hands-on roles at Wayfair and Flipdish. While my specialism lies in Google Ads, my tenure as a Facebook Business Support representative has given me a nuanced understanding of paid social. Across a range of sectors, including B2B, film, cosmetics, furniture and MRO, I've consistently delivered positive ROI via Google and Meta Ads. Specifically, one of my B2B clients, in a highly niched-down, hard to advertise in industry, saw an ROI of 12.7x, and another B2B client in the cosmetics industry saw a cost per lead of <£10, at a high volume. My technical skill set is comprehensive, featuring Python, Google Apps Script, SQL, SA360 and BigQuery, all of which enable me to automate and optimise PPC management effectively. When it comes to data, my approach is holistic. I employ Google Analytics and Google Tag Manager to ensure a complete understanding of every user touchpoint from initial visit through to conversion. Moreover, I use Google Looker Studio to transform your data into compelling stories. I'm open to new opportunities and keen to elevate your digital marketing efforts. Please feel free to get in touch; together, we can accomplish your project objectives.
    Featured Skill Big Data
    Forecasting
    Client Management
    BigQuery
    Python
    Pay Per Click Advertising
    Google AdSense API
    Looker Studio
    Marketing Automation
    Search Engine Marketing Strategy
    SQL
    Paid Social
    Revenue Management
    PPC Campaign Setup & Management
    Search Engine Marketing
    Google Ads
    Campaign Reporting
    Google Analytics
  • $50 hourly
    As a seasoned Data Scientist and Technical Product Manager, I bring extensive experience in Financial Crime Risk and Credit Risk management, coupled with deep proficiency in Python, Spark, SAS (Base, EG, and DI Studio), Hadoop, and SQL. Transitioning into freelancing, I am eager to leverage my skills to contribute to diverse projects. While Upwork's guidelines restrict sharing direct links to external profiles, I am happy to provide a detailed portfolio from my LinkedIn upon request.
    Featured Skill Big Data
    Data Mining
    Data Science
    Fraud Detection
    Data Analysis
    PySpark
    SAS
    Credit Scoring
    Apache Hadoop
    SQL
    Python
  • $50 hourly
    Data Scientist | AI Specialist | Python, SQL, Spark, MS Excel, Tableau, Power BI, Github, Docker, Airflow, LLM | +5 Years of Experience ◾️ Who I am? I am a full-stack data scientist with over 5 years of experience, helping businesses solve issues through data-driven approaches. Also, I've been recognized both as an industry leader and emerging talent by the UK Global Talent Program and as a top 1% mentor by ADPList (the largest online mentorship community). ◾️ Why work with me? ✅ I am reliable, trustworthy, and professional. ✅ I put your needs first and provide tailored solutions to ensure the finished product is a great fit. ✅ I have experience working across multiple industries with startups to global $2 billion turnover clients. ✅ I have over 5 years of industry experience across Data and AI. ◾️ More About Me 🔗 LinkedIn: younes-sandi/ 🔗 ADPList: adplist.org/mentors/younes-sandi 🔗 Github: github.com/Unessam 🔗 Website: ds4technology.com/ ◾️ Accepting • Data Analysis • Data Visualization • Web Scraping • Data Modeling • ETL • Data Manipulation • Machine Learning • Data Engineering • Automation and Pipeline Development • Model Deployment • LLM Development • MLOps • Tutoring • Mentorship ◾️ Tools • Python • SQL • Pyspark • Microsoft Azure • AWS • GCP • Tableau • Power BI • Google Analytics • Excel • Docker • Airflow • MLflow • Github • OpenAI • LangChain ◾️ Projects • Predictive Modeling • Recommendation Systems • Segmentation and Clustering • Path Analysis • LLM Integration • AI Integration • Business Automation • Sales & Demand Prediction • Customer Segmentation • Customer Attribution Modeling • Customer Churn/ Retention Prediction • Predictive Maintenance Modeling • Anomaly Detention and Modeling • NLP and Sentiment Analysis • Survival Analysis and Modeling • A/B Testing • Impact Analysis • Performing Complex Statistical Test
    Featured Skill Big Data
    AI Consulting
    OpenAI API
    LLM Prompt Engineering
    Survival Analysis
    Predictive Analytics
    Data Analysis
    PySpark
    Machine Learning
    Data Science
    Recommendation System
    Deep Learning
    Computer Vision
    SQL
    Python
  • $65 hourly
    Python developer with 7 years of professional experience, from writing scrapers to managing a full ETL and performing investigative data analysis. Having worked remotely for a start up I have no problem motivating myself and keeping up with a fast paced, changing environment. Working in a small team also gave me valuable experience in many roles outside of development such as devOps and onboarding new developers. I now want to dedicate some time to strengthening specific skills and experience working with different companies and structures. My background is in physics and I hold a first class masters degree, specialising in quantum decoherence. Following this I spent time researching quantum machine learning, and am fascinated by problems in cognition and consciousness, in particular the frontiers of how this could be implemented with AI and love to read about this in my free time.
    Featured Skill Big Data
    Web Scraping
    Data Engineering
    Data Structures
    SQL
    Python
    Data Science
    Quantum Physics
  • $80 hourly
    Experienced Principal Consultant with a passion for unlocking potential from data. Strong background in data science and data engineering. Love building intelligent products. Work with all levels of stakeholders to deliver robust and novel solutions. - Experienced on full Microsoft Data Platform stack - Databricks SME - Trainer with 25 Microsoft & Databricks certifications - R and Python Expert
    Featured Skill Big Data
    Azure Cosmos DB
    Continuous Improvement
    Cloud Computing
    Education Presentation
    Databricks Platform
    Continuous Integration
    Data Lake
    CI/CD
    Education
    Microsoft Azure
  • $80 hourly
    I am a programmer fluent in Python, SQL, and Cloud Technologies. I have a lot of experience working with data at scale including the design of automated pipelines and data warehouses. I have implemented self-service BI tools and designed bespoke reporting dashboards. I also have a lot of experience building automated scripts to scrape data from the internet and automate daily tasks. Completed Projects: - Data integrations with eCommerce API's (Walmart DSV, Amazon SP-API) - PDF text extraction via Python and OCR - Webapp created to interact with the text extraction script - API created to interact with the text extraction script - Fullstack Django WebApp created for a sport prediction game
    Featured Skill Big Data
    Django Stack
    Data Warehousing
    Looker
    Apache Spark
    Cloud Computing
    Apache Beam
    API
    Computing & Networking
    Apache Airflow
    Google Sheets
    Scripting
    JavaScript
    Automation
    Python
  • $40 hourly
    Data-driven and detail-focused experienced Data Analyst with a strong background in analysing large datasets, creating informative reports, and providing actionable insights. Expert in machine learning and analysis tools including Python, Tableau, R, Excel, Power BI, and SQL. Track record of leading and collaborating with cross-functional teams to drive business growth and meet project goals. Hold an MSc degree in Artificial Intelligence and Data Analytics.
    Featured Skill Big Data
    Data Modeling
    Artificial Intelligence
    Data Cleaning
    SQL Programming
    Research & Development
    Project Management
    Machine Learning
    Data Visualization
    Microsoft Excel
    Data Analysis
    Statistical Analysis
    Microsoft Power BI
    Google Analytics
    Python
  • $120 hourly
    World-class expert in clouds, storages, data platforms, and high-performance systems, having led teams and core projects at AWS S3 and Apple. US Inventor. Lately, I have been focusing primarily on Clouds, Data Platforms & Data Governance, but fluent in the entire big data stack, including DevOps methologies, high-performance JVM installations (incl Spring), databases and Data Science. I emphasize reliability, clearly written processes, and agile turnaround with all stakeholders. I am now bootstrapping my own B2B startup, where I handle CustDev, Product Management, GTM, complex UX, enterprise search with AI and everything else. I am not that proficient in these areas, but I am learning something new every day. As a hedge against startup turbulence, I am happy to share my core competencies with companies through Upwork!
    Featured Skill Big Data
    Artificial Intelligence
    Cloud Architecture
    Data Analysis
    Apache Hadoop
    Amazon S3
    Distributed Computing
    AI Bot
    Python
    Apache Spark
    Web Application
    Java
    Amazon Web Services
  • $45 hourly
    We are Experts in getting businesses in the Cloud with DevOps and Full stack solutions. Hello, I am Mohammed Ahmed, I’m a Cloud DevOps Engineer with more than 8 years of experience and over 22 in IT with experience in Open Source, Linux, Unix, Windows & DevOps Technologies. I have experience in Architecture Design, Implementation, Supporting Infrastructure and Applications in On-Premise and Cloud Environments like AWS, Azure, GCP and DigitalOcean particularly using tools and services like Docker, Kubernetes, Terraform, Cloudformation, with focussing on creating a very secure and highly available environment with great performance, monitoring, and cost optimisation. I have Extensive Hands-on Experience in Designing, Implementing, Supporting and Documenting a wide array of DevOps Environments, whether these are on-premise or in the Cloud. I also have huge expertise in CI/CD solutions with tools such as Jenkins, GitHub Actions, GitLab, and many more. Getting DevOps, DevSecOps architecture right in the cloud can be a daunting task, knowing the Ecosystem and feature set for your specific requirements can be problematic among the hundreds of services that a Cloud Service Provider like AWS, Azure, GCP introduces regularly and improves on, which is why we at AhmedMediaGroup Consultancy make this simple for you and offer Professional Service with the extensive know how in building robust and secure solutions, supporting customers with the assurance that your project will be handled professionally and courteously from start to finish. These are just some of the areas we have expertise in and cover, but please get in touch to get a complete overview of our solutions and offerings: ✅ DevOps ✅ Fullstack Application Development (SaaS and MVP Solutions) ✅ DevSecOps ✅ Linux (RedHat, CentOS, Ubuntu, SUSE) ✅ Amazon Web Services expertise (AWS): EC2, EKS, ECS, Fargate, EMR, Athena, Glue, Sagemaker, IAM, Serverless, Route53, CDN, S3, RDS and many more services ✅ Google Cloud Platform expertise (GCP) ✅ Azure Cloud expertise including Azure DevOps ✅ Digital Ocean Cloud expertise ✅ MLOps ✅ Apache Airflow ✅ MLFlow ✅ JupyterHub ✅ Sagemaker ✅ Data Warehousing, Data Lakes ✅ Continuous Integration, Continuous Delivery, CI/CD ✅ Docker ✅ Kubernetes ✅ Helm ✅ Karpenter ✅ EFK ✅ Prometheus ✅ Grafana ✅ Ansible ✅ Serverless (Lambda, Functions) ✅ Solution Architecture ✅ Infrastructure Automation ✅ Terraform, Cloudformation ✅ Automated Deployments ✅ Compliance, Code Checking Infrastructure and Application ✅ MERN Stacks ✅ LAMP Stacks ✅ Apache, NginX ✅ Git ✅ Networking, Network management ✅ Bash, Python, PHP, NodeJS, React ✅ SQL, NoSQL ✅ Open Source Application Configuration, Management, Support and Troubleshooting With over 22 years of experience in IT, I bring a wealth of knowledge and expertise along with a team to take on your project. We at AhmedMediaGroup run a well-oiled machine of highly skilled DevOps engineers that can deliver and support, scaleable, highly available, secure and fault-tolerant infrastructure and applications all using the newest tools to help your teams and business grow and achieve spectacular results. We run a very tight agile ship, providing regular daily updates via standup and meetings, integrating into your work teams and environment seamlessly. Our goal is simple, we help businesses deliver DevOps, DevSecOps, and Full stack solutions by adopting best practices, making things simple, automating deployments at every level and providing top-notch monitoring and operational support with a 24/7/365 response system.
    Featured Skill Big Data
    Terraform
    Amazon Web Services
    Amazon ECS
    Computing & Networking
    Load Balancing
    Security Infrastructure
    Kubernetes
    Docker
    AWS CloudFormation
    Amazon EC2
    AWS CloudFront
    DevOps
    WordPress
    Linux System Administration
  • $100 hourly
    Hello ! Thanks for dropping by 😊 I’m an expert with over 5 years experience in the following. 1. Data Engineering – both batch and streaming processing of data using Apache Kafka, Google Pub Sub, Apache Spark, Apache Airflow, Apache NiFi 2. Data Analysis – Experienced in carrying out various statistical analysis such as A/B testing, customer segmentation, churn prediction, time series forecasting, machine learning with tensorflow 3. Data warehousing – very experienced with Google BigQuery, PostgreSQL and Amazon Redshift 4. Data Visualisation – Expert in Google Data Studio, Klipfolio, Microsoft Power BI and intermediate user of Tableau, Mode 5. Data modelling and automation – heavy user of apache-airflow and apache-nifi, google-cloud-functions in python, amazon lambda functions. 6. Data Wrangling – I have a background as a developer using python, javascript, swift. So expert in building REST APIs or integrating with existing APIs Before data took over my life, I was a digital marketing expert for over 6 years in the areas of Search Engine Optimization (SEO), SMO, PPC, website speed optimization and email marketing. And this combination of data and business knowledge gives me the skillset to identify the KPI (key performance indicator) that is relevant to your business. This has immensely helped me in building business intelligence dashboards for varying businesses from e-commerce (Amazon, shopify), to SaaS startups to marketing agency dashboards and more. In addition I also conduct audits and make sure that clean data is generated/recorded in first place using the following 1. Auditing and setting up of Google Analytics for events and goal tracking. 2. Auditing and setting up of Google Tag Manager 3. Conversion tracking auditing and setup in Google-Ads, Facebook-ads, Bing-ads and more So do you feel like you have a challenging project? Let’s have a call Thanks, Vinay
    Featured Skill Big Data
    Data Analysis
    Looker Studio
    ETL
    Data Visualization
    Analytics
    Klipfolio
    MySQL Programming
    BigQuery
    Search Engine Optimization
    SEO Audit
    SEO Keyword Research
  • $45 hourly
    Welcome to My Profile! Are you seeking a seasoned Data Engineer with a proven track record of delivering exceptional results? Look no further! With over 9 years of hands-on experience in Data Engineering and Data Warehousing, I bring a wealth of expertise to the table. Who Am I? I'm Waleed Malik, a dedicated and results-driven professional specializing in ETL & Data Warehouse Development, Data Engineering, and Data Analytics. Throughout my career, I've had the privilege of working with multinational organizations, managing vast amounts of data on a daily basis, and spearheading complex projects from conception to completion. What Sets Me Apart? My passion for data and relentless pursuit of excellence set me apart in the field. I thrive on challenges and am committed to delivering top-notch solutions tailored to meet your specific needs. Whether you're looking to build robust data pipelines, implement self-service BI solutions, or design bespoke data warehouses, I've got you covered. Why Should You Hire Me? Proven Expertise: With a solid background in SQL, AWS, Python, and other cutting-edge technologies, I have the skills and know-how to tackle even the most demanding projects. Reliability: I pride myself on my professionalism, integrity, and commitment to excellence. You can trust me to deliver high-quality work on time, every time. Clear Communication: Effective communication is key to any successful project. I provide regular updates, solicit feedback, and ensure that we're always on the same page. Customer Satisfaction: Your satisfaction is my ultimate goal. I go above and beyond to ensure that you're happy with the end result, offering a 100% money-back guarantee if you're not completely satisfied. Long-Term Support: I believe in building lasting relationships with my clients. Even after the project is completed, I'm here to provide ongoing support and assistance as needed. Let's Work Together! Whether you're embarking on a big project or need assistance with smaller tasks, I'm here to help. From data modeling and analysis to cloud server management and everything in between, I've got the skills and expertise to bring your vision to life. Let's collaborate to turn your data into actionable insights and drive your business forward. Get in touch today, and let's make great things happen together!
    Featured Skill Big Data
    Data Visualization
    Google Cloud Platform
    AWS Lambda
    Bash Programming
    Teradata
    SQL
    Data Migration
    Python
    ETL Pipeline
  • $70 hourly
    I am a Senior Data Engineering specialist with 9+ years of experience building data pipelines and analytic platforms that turn raw data into actionable insights. My work focuses on designing scalable ingestion, transformation, and storage solutions using technologies like Spark, Kafka, Airflow, and cloud data warehouses (Snowflake, Redshift, BigQuery). I’ve streamlined ETL processes to handle terabytes of data daily, ensuring high throughput, data integrity, and cost-efficiency. Clients benefit from timely, accurate data that powers real-time dashboards, machine learning workflows, and mission-critical reporting. I am AWS Cloud expert with DevOps specialties with me, worked on Data oriented projects and managed CI/CD pipelines, data pipelines and cloud infrastructure in IaC (Terraform/Cloudformation) for the same project. Skills: • Data Ingestion & Streaming: Kafka, AWS Kinesis, Google Pub/Sub, RabbitMQ • Big Data Processing: Apache Spark, Hadoop (HDFS, Hive, MapReduce), Databricks • ETL/ELT & Workflow Orchestration: Apache Airflow, AWS Glue, dbt, Talend • Databases & Warehouses: Snowflake, Amazon Redshift, Google BigQuery, Azure Synapse • Programming & Scripting: Python (PySpark, Pandas), SQL, Scala, Bash • Cloud Services: AWS (EMR, S3, Athena), GCP (Dataflow, BigQuery), Azure (Data Factory) • NoSQL & Storage: DynamoDB, MongoDB, Cassandra, HBase • Data Modeling & Schema Design: Star/Snowflake schemas, partitioning, indexing •BI/Visualization: Tableau, Power BI, Looker, QuickSight • Data Governance & Quality: Great Expectations, Deequ, data lineage, metadata management • Performance Optimization: Query tuning, Spark job optimization, partition pruning
    Featured Skill Big Data
    Data Analysis
    Data Science Consultation
    Database
    ETL Pipeline
    Data Migration
    ETL
    DevOps
    PostgreSQL
    Apache Spark
    Docker
    Java
    Amazon Web Services
    Python
  • $15 hourly
    Are you ready to unlock the full potential of your data and transform your business with advanced big data solutions and strategic cloud consulting? I am a seasoned professional specializing in enterprise-grade data engineering, cloud infrastructure, and digital transformation, with a proven track record of delivering scalable, high-performance solutions. What I Bring to the Table: End-to-End Big Data Solutions: Expert design and implementation of Cloudera-based platforms Robust data pipeline development using Hadoop, Spark, and advanced ETL processes Real-time analytics and business intelligence integration for actionable insights Comprehensive Cloud Consulting: Certified Google Professional Architect, Certified Azure Administrator Associate, Strategic planning and seamless data migration across AWS, Azure, and Google Cloud Platform Tailored hybrid cloud architectures that balance agility, scalability, and security Cloud-native application deployment to optimize performance and reduce operational costs Enterprise-Grade Systems & Digital Transformation: Proven experience in modernizing legacy systems and driving digital transformation initiatives Collaboration with C-level executives and cross-functional teams to align technology with business objectives Leadership in deploying innovative solutions that enhance operational efficiency and drive measurable ROI Business-Focused Approach: Customized strategies that integrate data analytics, enterprise systems, and cloud solutions A clear focus on delivering competitive advantages through digital excellence Dedicated support from initial consultation through to project delivery and beyond I thrive in fast-paced, high-pressure environments and excel at translating complex technical challenges into strategic opportunities for growth and innovation. Whether you need to optimize your data ecosystem, migrate your infrastructure, or drive a comprehensive digital transformation, my expertise will ensure your business stays ahead in today's competitive digital landscape. Let’s Connect! If you’re looking for a results-oriented consultant to elevate your big data and cloud strategy, let’s discuss how we can collaborate to drive your business forward. Together, we can build a customized solution that enhances efficiency, fosters innovation, and propels your organization to new heights. Reach out today to start your journey towards digital excellence!
    Featured Skill Big Data
    Apache Administration
    YARN
    Apache Zookeeper
    Hive
    Microsoft 365 Copilot
    Microsoft Azure
    Google Cloud Platform
    Cloud Architecture
    Apache Hive
    Apache NiFi
    Apache Kafka
    Linux System Administration
    User Authentication
    Apache Hadoop
    Cloudera
    Apache Spark
    Amazon Web Services
  • $50 hourly
    I am a scientist and analyst with a PhD in Cancer Biology and extensive postdoctoral research experience, specializing in oncology and hematology. Throughout my academic and professional career, I have honed my expertise in systematic literature reviews, network meta-analysis, and consulting. -PhD in cancer biology -12 Years of Research Experience in Cancer Biology -2 years experience in Pharma consulting -Experience in writing scientific articles and medical reports -Experience in Oncology Drug Discovery and Biomarker Development -Big data analysis in R and Excell -Experience in -Proteomics and RNAseq Research -6 Academic Awards -15 Peer-Reviewed Publications in High-Impact Journals -15 Poster and Oral Presentations
    Featured Skill Big Data
    Writing
    Regulatory Intelligence
    Regulatory Compliance
    Drug Regulation
    Biology
    Drug Discovery
    Business Intelligence
    Cancer
    Excel Formula
    Biology Consultation
    Pharmaceutical Industry
    Cellular Biology
    Molecular Biology
    Biochemistry
  • $50 hourly
    I am a driven and excited machine learning scientist currently doing a PhD with a focus on graph neural networks and big spatiotemporal data. I have strong communication and collaboration skills with experience doing large-scale data analysis and modelling, rapid iteration for effective problem solving and working and presenting directly to clients in an easy-to-understand way.
    Featured Skill Big Data
    Graph Neural Network
    Artificial Intelligence
    Cloud Computing
    Deep Learning
    Blockchain
    Deep Neural Network
    Data Analysis
    Data Visualization
    Python
  • $80 hourly
    I have more than 5 years of hands-on experience in the design and the development of data engineering solutions on Google Cloud Platform (GCP). I have designed and developed several batch and realtime streaming pipelines successfully processing millions of events. Experienced in working from small to large organisations (Nokia, Expedia, Square-Enix and ITV to name a few). I focus on understanding and identifying the actual issues and solve them in a best possible way. I have a PhD. in Computer Science.
    Featured Skill Big Data
    Google Cloud Platform
    Data Analysis
    Terraform
    Node.js
    Cloud Computing
    Apache Beam
    Cloud Engineering
    BigQuery
    SQL
    Java
    Python
    Data Engineering
    Kubernetes
    Apache Airflow
  • $50 hourly
    Cybersecurity Red Team Expert with 2 Years of Experience in Penetration Testing, Vulnerability Assessment, and Threat Simulation Overview: As a dedicated Red Team Cybersecurity Expert with over two years of experience, I specialize in simulating real-world cyberattacks to identify vulnerabilities and assess security posture. My expertise lies in penetration testing, vulnerability assessments, and threat simulation, allowing organizations to uncover weaknesses before malicious actors exploit them. I am proficient in ethical hacking, network security, and attack simulations, and I have a strong command of tools like Kali Linux, Metasploit, and Burp Suite. My goal is to provide actionable insights that enhance the security and resilience of businesses. Skills: - Penetration testing - Vulnerability assessments - Threat simulation - Ethical hacking - Kali Linux - Metasploit - Burp Suite - Network security - Web application security - Exploit development Experience: Worked as a Red Team Cybersecurity Specialist at Arena Web Security for 2 years, where I was responsible for simulating advanced persistent threats (APTs) and conducting comprehensive vulnerability assessments. I collaborated with Blue Teams to identify attack vectors and improve incident response capabilities. My efforts directly strengthened the organization’s defense mechanisms against sophisticated cyber threats.
    Featured Skill Big Data
    WordPress Security
    Web App Penetration Testing
    Penetration Testing
    Red Team Assessment
    Vulnerability Assessment
    OWASP
    SQL Programming
    R
    Microsoft Excel
    Python
  • $80 hourly
    Summary * 20 years of overall experience as lead BI, Big Data, Reporting and Visualization specialist with experience in data engineering, report automation, data integration, ETL architecture, and data migration projects. * 10 years of technical project management experience and strong knowledge on PMI-PMP and agile project management methodologies and stakeholder management. * 9 years of experience in end-to-end Power BI / QlikView implementations as self-service BI tool. * 2 end to end implementation of Machine Learning data engineering pipeline on production environments. * End to end Snowflake, DBT and Fivetran implementation experience. * Developed and deployed Big Data Hadoop solutions using Spark, Hive, SSAS, SSIS and Power BI. * Hands-on experience leading all stages of system development life cycle, including requirements definition, design, development, testing, maintenance and support. * Experienced in extracting data from business systems, harvesting information from web, processing
    Featured Skill Big Data
    Apache Spark
    Project Management
    Oracle PLSQL
    SPARQL
    Apache Hive
    Apache Hadoop
    PySpark
    QlikView
    SQL
    Microsoft Power BI
  • $51 hourly
    Big Data expert with 6+ years of experience, leading projects for 𝐖𝐢𝐳𝐳𝐀𝐢𝐫, 𝐂𝐢𝐬𝐜𝐨, 𝐂𝐨𝐨𝐩 and for successful Start-Ups 𝐁𝐫𝐨𝐲𝐚𝐥𝐢𝐯𝐢𝐧𝐠.𝐜𝐨𝐦 (leading organic meals e-commerce in Canada), 𝐌𝐞𝐝𝐢𝐤𝐢𝐭.𝐮𝐚 (largest telemedicine company in Ukraine, 𝟏𝟎𝟎 𝟎𝟎𝟎+ 𝗰𝗼𝗻𝘀𝘂𝗹𝘁𝗮𝘁𝗶𝗼𝗻𝘀 𝐦𝐚𝐝𝐞) 𝗦𝗼𝗺𝗲 𝗼𝗳 𝗺𝘆 𝗿𝗲𝗰𝗲𝗻𝘁 𝗽𝗿𝗼𝗷𝗲𝗰𝘁𝘀: - 𝐄𝐓𝐋 𝐩𝐢𝐩𝐞𝐥𝐢𝐧𝐞𝐬 for ensuring batch data processing within centralised data warehouse for a 𝐆𝐞𝐫𝐦𝐚𝐧 𝐥𝐨𝐠𝐢𝐬𝐭𝐢𝐜𝐬 𝐜𝐨𝐦𝐩𝐚𝐧𝐲. - 𝐃𝐚𝐭𝐚 𝐦𝐢𝐠𝐫𝐚𝐭𝐢𝐨𝐧 from Hadoop to AWS infrastructure for 𝐅𝐨𝐫𝐭𝐮𝐧𝐞 𝟓𝟎𝟎 𝐞𝐧𝐭𝐞𝐫𝐩𝐫𝐢𝐬𝐞. - 𝐒𝐩𝐚𝐫𝐤 𝐒𝐭𝐫𝐞𝐚𝐦𝐢𝐧𝐠 application for KPI calculations & data enrichment, enabling detection of network vulnerabilities at the 𝐔𝐒-𝐛𝐚𝐬𝐞𝐝 𝐭𝐞𝐥𝐞𝐜𝐨𝐦. - Unique 𝐝𝐚𝐭𝐚 𝐚𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭𝐮𝐫𝐞 𝐥𝐨𝐠𝐢𝐜 for a pharmaceutical research centre in the US - 𝐀𝐈-𝐝𝐫𝐢𝐯𝐞𝐧 𝐝𝐚𝐭𝐚 𝐩𝐥𝐚𝐭𝐟𝐨𝐫𝐦 to perform advanced analytics for the largest groceries 𝐫𝐞𝐭𝐚𝐢𝐥𝐞𝐫 𝐢𝐧 𝐃𝐞𝐧𝐦𝐚𝐫𝐤. 𝗪𝗵𝗮𝘁 𝗶 𝗱𝗼 𝗳𝗼𝗿 𝗰𝗹𝗶𝗲𝗻𝘁𝘀: 𝗗𝗮𝘁𝗮 𝗔𝗿𝗰𝗵𝗶𝘁𝗲𝗰𝘁𝘂𝗿𝗲 & 𝗠𝗮𝗻𝗮𝗴𝗲𝗺𝗲𝗻𝘁 • Design scalable, resilient big data architectures • Manage data lakes/warehouses with optimized query performance, quality, and governance 𝗗𝗮𝘁𝗮 𝗣𝗿𝗼𝗰𝗲𝘀𝘀𝗶𝗻𝗴 & 𝗢𝗿𝗰𝗵𝗲𝘀𝘁𝗿𝗮𝘁𝗶𝗼𝗻 • Build efficient ETL pipelines (Spark, Glue, Athena, DBT, etc.) • Orchestrate workflows using Airflow, Data Factory, Databricks Jobs, Lambda, and Azure Functions 𝗖𝗹𝗼𝘂𝗱 & 𝗗𝗮𝘁𝗮𝗯𝗮𝘀𝗲 𝗦𝗼𝗹𝘂𝘁𝗶𝗼𝗻𝘀 • Expertise across AWS, Azure, and GCP • Manage diverse databases: SQL (MySQL, PostgreSQL, Oracle, BigQuery) and NoSQL (MongoDB, Redis, Snowflake, TimescaleDB) • Leverage additional cloud services (AWS S3, SageMaker, EKS/ECS; Azure Synapse, ADLS; GCP BigQuery, Hadoop, etc.) 𝗥𝗲𝗮𝗹-𝗧𝗶𝗺𝗲 𝗗𝗮𝘁𝗮 𝗦𝘁𝗿𝗲𝗮𝗺𝗶𝗻𝗴 • Implement streaming solutions with Apache Kafka, Fivetran, Spark Streaming, and related tools 𝗥𝗲𝘃𝗶𝗲𝘄𝘀: ⭐⭐⭐⭐⭐ - 𝐍𝐢𝐦𝐚 𝐒𝐨𝐭𝐨𝐚𝐝𝐞𝐡, 𝐂𝐄𝐎 𝐨𝐟 𝐁𝐫𝐨𝐲𝐚 Nick has been an incredible asset to us at Broya. His data engineering expertise is not only profound but also practically applied to real-world problems. His work has significantly contributed to the success of our projects and data pipeline creations. He is a true professional and a pleasure to work with. ⭐⭐⭐⭐⭐ - 𝐑𝐮𝐬𝐥𝐚𝐧 𝐊𝐫𝐚𝐯𝐞𝐭𝐬, 𝐂𝐄𝐎 𝐨𝐟 𝐌𝐞𝐝𝐢𝐤𝐢𝐭 Working with Nick has transformed our approach to data management at 𝐌𝐞𝐝𝐢𝐤𝐢𝐭. His contributions were crucial in developing an efficient and automated data management system, complemented by real-time dashboarding, which has streamlined our operations and decision-making processes. Beyond his technical expertise, Nick's commitment to excellence has played a key role in enhancing our data handling capabilities and overall operational efficiency.
    Featured Skill Big Data
    Cloud Security
    Cloud Services
    Apache Kafka
    Databricks Platform
    SQL
    Apache Spark
    ETL Pipeline
    Data Migration
    Database Optimization
    Database Architecture
    Data Visualization
    Data Quality Assessment
    Data Analytics
    Data Engineering
  • $50 hourly
    PERSONAL PROFILE Peace Lawson is a Geology graduate with a Master's degree in Petroleum Geosciences. I transitioned into Data Analysis due to the increasing demand for Big Data experts. After completing a 12-week Digital Skills Bootcamp at Just IT, I gained proficiency in MySQL, Azure, Excel, R, Tableau, and Power BI. My foundation in data entry, attention to detail, and aptitude for analysis give me the confidence to contribute to data-driven decision-making. My passion for uncovering meaningful patterns drives me. I excel in data organization and integrity, maintaining confidentiality and security. These skills have provided me with a solid understanding of data structures, data organization, and data quality control. With my ability to uphold confidentiality and data security, I strive to support the organization's success through accurate and timely data management. Beyond technical expertise, I possess excellent communication skills both verbal and written,
    Featured Skill Big Data
    Technical Support
    Phone Communication
    Customer Service
    Tech & IT
  • $35 hourly
    As a data analyst with a PhD in biostatistics, I excel at uncovering valuable insights from a wide range of data sources. My diverse skillset in R, Python, SQL, and Tableau allows me to deliver tailored, data-driven solutions to meet my clients' unique needs. 𝗪𝗵𝘆 𝗖𝗵𝗼𝗼𝘀𝗲 𝗠𝗲? 🛠️ I'm proficient in data cleaning, statistical modeling, machine learning, and network analysis. I have a knack for tackling complex analytical challenges with a creative and meticulous approach. 💡 My diverse skillset allows me to transform raw data into meaningful insights and visualizations. I'm skilled at identifying hidden patterns and trends. 🧹 I also pride myself on my data cleaning and organization abilities. I'll work closely with you to wrangle your data, build robust data models, and ensure everything is ready for your own analytics and algorithms. 💬 I'm an effective communicator, able to bridge the gap between data and decision-makers. My ability to explain complex topics in simple terms ensures you can confidently act on my recommendations. 𝗣𝗿𝗼𝗳𝗲𝘀𝘀𝗶𝗼𝗻𝗮𝗹 𝗘𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲 (𝘀𝗲𝗲 𝗣𝗼𝗿𝘁𝗳𝗼𝗹𝗶𝗼): • Analysed large datasets with custom-built workflows for extraction, transformation, loading and statistical data analysis. • Developed a data preprocessing pipeline to handle, impute, and analyse qPCR data affected by a large proportion of missing data (up to 60%). • Automated behaviour detection in animal groups creating an analytical suite based on supervised classification. This reduced data collection time by two orders of magnitude and enabled 4 scientific studies in preparation. 𝗔𝘀 𝘆𝗼𝘂𝗿 𝗱𝗮𝘁𝗮 𝗮𝗻𝗮𝗹𝘆𝘀𝗶𝘀 𝗽𝗮𝗿𝘁𝗻𝗲𝗿, 𝗜'𝗹𝗹 𝗹𝗲𝘃𝗲𝗿𝗮𝗴𝗲 𝗺𝘆 𝗲𝘅𝗽𝗲𝗿𝘁𝗶𝘀𝗲 𝘁𝗼: 📚 Thoroughly research your problem to implement the most adequate solutions. 🔍 Uncover hidden patterns and trends in your data (exploratory data analysis and modeling). 📊 Create easy-to-understand and insightful plots and reports. 🌟 Translate complex technical findings into clear, actionable insights. Let's collaborate to unlock the full potential of your data and propel your business forward. 🤝
    Featured Skill Big Data
    Biostatistics
    Data Analysis
    Epidemiology
    Life Science
    Research & Development
    Visualization
    Analytics
    Statistical Analysis Language
    Python
    SQL
    R
    Machine Learning
    Predictive Modeling
    Statistics
  • $35 hourly
    I am a seasoned Data Engineer with years of experience in designing, developing, and optimising data architectures. Passionate about transforming raw data into actionable insights, I excel at building robust and scalable data pipelines, implementing efficient ETL processes, and ensuring data integrity across diverse platforms.
    Featured Skill Big Data
    Cloud Security
    Apache Spark
    Python
    SQL Programming
    Solution Architecture
    Cloud Computing
    Data Engineering
    Azure DevOps
  • $25 hourly
    I am a highly skilled Data Engineer with over 4 years of experience developing scalable and efficient data solutions. I specialize in building and optimizing automated data pipelines, ensuring high data quality, and driving actionable business insights. With expertise in big data tools like Apache Spark, Hadoop, AWS Glue, and Azure Databricks, I can help you streamline data workflows, reduce processing time, and enhance reporting capabilities. I have successfully led data warehouse migrations, and automated ETL processes, and collaborated with cross-functional teams to design robust data architectures. I also have hands-on experience applying machine learning models to enhance data analytics and build predictive systems. Whether you need data integration, transformation, or AI/ML-driven analytics optimization, I bring a problem-solving mindset and deep technical know-how to deliver high-impact solutions. Hire me for: 🔸End-to-end development of scalable data pipelines. 🔸Data lake and data warehouse architecture design. 🔸ETL/ELT implementation for diverse data sources. 🔸Machine learning model deployment and integration with data pipelines. 🔸Optimization of SQL queries and data workflows. 🔸Migration of legacy data warehouses to modern data lakes. 🔸Automation of data processes to improve accuracy and availability. 🔸Integration of e-commerce data (Google, Amazon, Facebook, etc.) for reporting and analytics. 🔸and many more data services.. Expert Data Engineer | Azure Certified Data Engineer | Big Data Architecture | Cloud Data Warehousing | Data Lakehouse| Data Lake | ETL/ELT Pipelines | Data Modeling | Business Intelligence | Machine Learning | Python | SQL | Apache Spark | Kafka | Kinesis | AWS Glue | AWS Athena | AWS EMR | Data Quality | Data Security | Apache Icebergn When you bring me on board, you can count on: 🔸 Exceptional results and top-notch service 🔸 Consistently high-quality work delivered promptly 🔸 Clear and effective communication 🔸 Frequent updates to keep you informed I am committed to your satisfaction, and I won’t consider the job done until you are satisfied with the outcome!
    Featured Skill Big Data
    Big Data File Format
    Data Modeling
    Apache Spark
    Mobile App Development
    Web & Mobile Design Consultation
    Software Development
    Data Lake
    Data Warehousing
    ETL Pipeline
    Data Analytics
    Data Extraction
    Data Cleaning
  • $65 hourly
    Experienced data scientist with 5+ years of experience in analyzing large-scale biological datasets, leveraging machine learning, and statistical modeling in cancer research. Strong background in genomics and computational biology to generate novel biological insights. Adept at managing complex projects and collaborating with interdisciplinary teams. Seeking opportunities to contribute to transforming patient's health and wellbeing with digital biology. Committed to responsible AI practices. Specialization: Data Analysis, Machine Learning, Computational Biology, Cancer Research, AI in HealthTech, Content Writing, Full Project Management
    Featured Skill Big Data
    Writing
    Statistical Analysis
    Dimensionality Reduction
    SQL
    R
    PyTorch
    PySpark
    TensorFlow
    pandas
    Python
    Artificial Intelligence
    Data Mining
    Machine Learning
    Data Analysis
  • Want to browse more freelancers?
    Sign up

How hiring on Upwork works

1. Post a job

Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.

2. Talent comes to you

Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.

3. Collaborate easily

Use Upwork to chat or video call, share files, and track project progress right from the app.

4. Payment simplified

Receive invoices and make payments through Upwork. Only pay for work you authorize.

Trusted by 5M+ businesses