Hire the best Pyspark Developers in Australia

Check out Pyspark Developers in Australia with the skills you need for your next job.

Get started

$45 hourly
Taz K.
- 5.0/5
- (8 jobs)
Experienced as a Full Stack Developer for 8+ years. Currently working on building ETL Pipelines and SQL report generation and Infrastructure as Code using terraform. Interested in opportunities that challenge and reward existing skill set. Key Skills  Gained Experience in Working on AWS Platform  Building Pyspark / Pandas ETL AWS Glue jobs or AWS Lambdas  Building Nifi Flows  Generating SQL Reports  Creating Python Flask APIs with SQLAlchemy and Kafka  Deploying Docker containers  Enhance Midwich SaaS Monitoring platform with snippets built using Python to interface with REST /SOAP APIs of leading Audio Visual Vendor Equipment , ITSM Cloud Providers and Microsoft Azure.  Custom API Development using FLASK and DJANGO.  Experience Working on Full Stack Web Development in Flask and Django  Experience Working on Full Stack Web Development in Laravel/CodeIgniter  Experienced in Python ,PHP, REST API, REACT , SOAP, HTML/CSS , JS,AJAX , C#,LAMP Stack Architecture , JQuery, Bootstrap 5.0.  Experience creating Mobile App backend in Python  Integrate with industry leading ITSM Cloud providers such as Salesforce, ServiceNow, JIRA, ZendDesk, FreshService using REST API.  Knowledge of Full Stack JavaScript Development including Node.js, Express.js, Node Package Manager)  Knowledge of MVC Framework and Code Igniter / Laravel as a Framework  WordPress using Page Builders e.g Divi , Elementor , Beaver Builder , WPBakery , Visual Composer etc  WordPress custom Theme Development and plugin Development.  Version Control Software like Git and SVN using Github and BitBucket for storing the repositories  Relational Database Design and Development in MySQL and PostgreSQL  Experience with project management systems like Basecamp, JIRA, Slack.

Pyspark
Terraform
NumPy
pandas
PySpark
ETL
Git
Django
AWS Glue
SQLAlchemy
Flask
AWS Lambda
MySQL Programming
JavaScript
Python
PostgreSQL
$56 hourly
Taeef N.
- 5.0/5
- (149 jobs)
Hello! I'm a seasoned Data Engineer with over 3 years of experience crafting efficient and reliable data pipelines. I specialize in end-to-end data solutions, from ingestion and transformation to storage and visualization, helping businesses unlock the full potential of their data. Here's how I can add value to your projects: 🌟 Data Ingestion & Automation: I streamline data ingestion using top tools like Meltano, Airbyte, and DLT to automate and maintain high-quality data flow across multiple sources, making data accessible and actionable. 💡 ELT & Data Transformation with DBT: I transform raw data into insights using DBT, optimizing for performance and scalability. My hands-on experience with SQL and Python ensures transformations are efficient, clean, and tailored to your business needs. 💾 Storage Systems Expertise: I have extensive experience setting up and managing diverse storage solutions, from traditional databases to distributed systems. I also work with Iceberg, MinIO, and S3 to keep data organized and readily available for querying and analytics. ⚙️ Data Processing with Spark: With my Spark expertise, I can handle large-scale data processing tasks efficiently, leveraging parallel processing for fast and scalable solutions. 📊 Data Visualization & Insights: I turn data into decisions with powerful visualizations in tools like Tableau, Power BI, Plotly, Superset, and Metabase, ensuring that insights are clear, actionable, and accessible to stakeholders. I'm passionate about building data solutions that drive business impact. Whether you're looking to set up a robust data pipeline, optimize your data processing workflows, or create insightful dashboards, I’m here to help bring your data vision to life. Let's connect and discuss how I can support your project!

Pyspark
ETL Pipeline
Data Lake
Data Transformation
Data Ingestion
Tableau
Microsoft Power BI
Data Analysis
Data Visualization
Data Warehousing
PySpark
Apache Spark
dbt
Data Engineering
SQL
Python
$35 hourly
Shabanu S.
- 0.0/5
- (0 jobs)
Developer,python, sql, flask, django, Figma, HTML, Rest API, Adobe Photoshop, Share point , jenkinsAWS, confluence, jira, bitbucket, odoo, hive, spark, atlas, ci/cd,Hadoop,SQL,ETL,ADF,Azure Synapse,Azure Databricks,AZURE CI CD

Pyspark
PySpark
Apache Hive
SQL
Microsoft Azure
Python
$15 hourly
Naveed K.
- 5.0/5
- (6 jobs)
I am a machine learning researcher currently pursuing a PhD at the University of Melbourne (ranked 13th in the world). With over 5 years of experience, I have contributed to advanced projects in machine learning and signal processing. I have a proven track record of collaborating with international clients on various freelance platforms. What I Offer (not limited to): o Machine learning and deep learning model development o Computer vision using CNN and hybrid models (e.g., object detection, segmentation) o Time series analysis using LSTM, Transformers, and hybrid models o Federated learning for distributed AI in medical imaging o Model interpretability techniques (e.g., SHAP, Explainable AI) o Generative models (neural style transfer, text generation) o ECG and EEG signal analysis for event detection and recognition o Image processing: super-resolution, denoising, and similarity detection o Signal processing and filter design (Fourier, IIR, FIR) In addition to my technical skills, I have taught machine learning and computer vision concepts through platforms like Preply and YouTube, reaching a global audience of learners. I’m passionate about sharing my knowledge while continuously expanding my own skill set. Whether you’re looking to solve a specific AI problem or need expert insights for your project, I’m here to help. Let’s discuss how I can contribute to your success!

Pyspark
PySpark
Data Analysis
Time Series Analysis
Python
Deep Learning
Natural Language Processing
PyTorch
Python Scikit-Learn
TensorFlow
Neural Network
Machine Learning
Keras
Computer Vision
Data Science
pandas
$50 hourly
Antony P.
- 0.0/5
- (0 jobs)
Seasoned data professional with over a decade of diverse industry experience, currently based in Sydney, Australia. My expertise spans data domains from solution architecture to deployment, ingestion and warehousing to visualisation and application integration, across sectors such as networking infra, insurance, media, and, most recently, hospitality. Proficient in building data solutions, big data technologies like PySpark and Snowflake, as well as cloud platforms such as AWS and Azure, I am dedicated to delivering data-driven solutions and working with and/or leading teams to success.

Pyspark
Analytics
Data Analysis
Data Analytics & Visualization Software
Data Analytics Framework
Big Data
Cloud Development
ETL Pipeline
Python
SQL
Apache Spark
AWS Glue
Data Engineering
PySpark
$110 hourly
Anup N.
- 0.0/5
- (0 jobs)
With over 12 years of experience in software engineering and project management, I specialize in leading teams to successfully deliver complex IT solutions. Whether it’s managing remote teams, streamlining processes, or rescuing failing projects, I bring a results-driven approach to every challenge. Highlights: Led a team of 6 offshore developers to deliver a previously stalled project. Expert in Agile methodologies, team coordination, and risk management. Proven track record of completing high-pressure projects on time and within budget. Let’s collaborate to take your project to the next level.

Pyspark
Risk Management
Databricks MLflow
Stakeholder Management
Cross Functional Team Leadership
Project Management Software
Amazon S3
AWS Glue
Databricks Platform
PySpark
SQL Programming
PostgreSQL
AWS Lambda
C#
.NET Framework
Python
$55 hourly
Hupa N.
- 0.0/5
- (1 job)
I'm a Microsoft Certified professional and working as a consultant serving comprehensive consulting services across Microsoft Technology stack, expertise in Microsoft Power Platform, Power BI and Microsoft Fabric, and Dynamics 365, that require a blend of competencies in the roles of Business Analyst, Solution Architect, Data Engineer, Data Analyst, and Business Intelligence Specialist. My core competencies span across a wide range of technologies including Power Platform, Dataverse, Microsoft Fabric, Power BI, Power Automate, Power Apps, Power Pages, Business Central, SharePoint, Azure Data Lake Storage Gen 2, Azure Entra ID, Azure Data Factory, Graph API, SSRS, Power Fx, DAX, Power Query, SQL, KQL, XML, Python, R, Scala, and Spark. I employ a customer-centric approach in delivering my business solution. Read more at powerappsdeveloper.com

Pyspark
PySpark
Python
SQL Server Reporting Services
SQL Programming
Power Query
Microsoft Azure
Microsoft Dynamics Development
Microsoft Active Directory
Microsoft Dynamics ERP
Microsoft Dynamics CRM
Microsoft Dynamics 365
Microsoft PowerApps
Microsoft Power Automate
Microsoft Power BI
Microsoft Certified Professional
$40 hourly
Thanh Chung N.
- 0.0/5
- (0 jobs)
I'm a Data Engineer experienced building scalable data pipelines, cloud architectures, and automated ETL/ELT workflows to support business intelligence and analytics. ✔ Expert in Python, SQL, Spark, AWS, GCP and Azure ensuring efficient data processing and automation. ✔ Manage end-to-end projects, from data ingestion, data modelling to deployment, ensuring efficiency and reliability. ✔ Strong communication and attention to detail, delivering high-quality, well-documented solutions.

Pyspark
DevOps
Terraform
Google Cloud Platform
Amazon Web Services
Microsoft Azure
Databricks Platform
Snowflake
Data Modeling
Analytical Presentation
SQL
Python
PySpark
Data Engineering
ETL Pipeline
ETL
$150 hourly
Brajendra K.
- 0.0/5
- (0 jobs)
Experienced data engineer specializing in high-performance data processing with Apache Spark, Python, and Databricks. I help businesses optimize their data pipelines, reduce processing costs, and accelerate insights delivery. My Approach: I don’t just write code - I solve business problems. Every optimization I deliver focuses on reducing costs, improving reliability, and accelerating time-to-insights. I provide clear documentation and knowledge transfer so your team can maintain the solutions

Pyspark
Data Extraction
Git
CI/CD
Schema Diagram
Data Migration
Data Modeling
Unix Shell
Apache Hadoop
Data Warehousing
ETL Pipeline
Databricks Platform
Python
SQL
PySpark
Apache Spark
$80 hourly
Mahdi K.
- 0.0/5
- (1 job)
* PhD in machine learning from the University of Adelaide, 2022 (top machine learning and computer vision group in Australia and 6th globally) * Winner of multiple prizes and challenges * Experienced in developing machine learning and computer vision tools for different applications, e.g. automated surveillance and monitoring, bushfire management, sports performance analysis etc. * Mentor and thought leader * Always looking for new problems and novel ways to challenge myself * Self-motivated, organised, hardworking, and actively looking to learn new skills and expand technical knowledge Feel free to reach out if you are looking for someone to reliably take care of your problem until it is solved, or otherwise proven (temporarily) unsolvable!

Pyspark
Communication Skills
Data Engineering
Robot Operating System
Big Data
QGIS
LaTeX
PySpark
Python Scikit-Learn
C++
Computer Vision
Python
Deep Learning
Machine Learning
PyTorch
Reinforcement Learning
$20 hourly
Prince P.
- 0.0/5
- (0 jobs)
🚀 Data Analyst | Power BI | SQL | Tableau | Dashboard Design | Business Intelligence (BI) 📍 Based in Adelaide, SA | 1+ Years of Industry Experience | Full Working Rights in Australia Hi there! I'm Prince Padhiyar, a data-driven professional with over a year of hands-on experience helping start-ups, enterprises, and government agencies transform raw data into powerful insights. I specialise in Power BI dashboards, SQL analysis, customer behaviour analytics, and business intelligence reporting that lead to measurable improvements in performance and decision-making. ✅ What I Offer With a strong foundation in data modelling, KPI analysis, and trend forecasting, I deliver results that go beyond charts — results that solve real business problems. I’ve led and contributed to 10+ data projects for organisations like WryteAI, Plant for Everyone, and the South Australia Ambulance Services, consistently improving operational efficiency, customer retention, and strategic planning. 💼 Services I Provide 📊 Power BI & Tableau Dashboard Development 🧠 Customer Behaviour & Retention Analysis 📂 Data Cleaning, Integration & Standardisation 📈 KPI Reporting & Executive-Level Dashboards 💡 Business Intelligence Consulting 🔎 SQL Querying & Database Management 🔗 Google BigQuery | GCP | Azure Data Studio 🧹 Data Scraping, Validation & Transformation 📁 ELT Pipelines | DAX | Power Query 🔍 Key Achievements Built and maintained an Executive Dashboard for WryteAI, analysing 1.1M+ token usage records and 50K+ customer profiles—increased CSAT by 10% and improved product decisions. Developed a comprehensive data report for "Plant for Everyone", identifying high plantation zones and customer preferences using Power BI, SQL, and MySQL, influencing business growth strategies. Conducted CSAT and NPS trend analysis from 60K+ survey reviews, enabling stakeholder communication and product refinement. Improved document management systems at SA Ambulance Services, ensuring accurate billing and compliance using Oracle E-Business Suite and strict data governance protocols. Delivered insights that helped reduce transaction times by 20% and labour costs by $15K annually. 📚 Certifications Microsoft Certified: Azure Fundamentals Microsoft Certified: Data Fundamentals Certified Data Analyst – The Data Analytics Institute Australia ITIL v4 Foundation – Udemy 🛠️ Technical Stack Power BI, Tableau, SQL, Python, Excel, DAX, GCP, BigQuery, MySQL, Google Sheets, Azure, Oracle Revenue Management & Billing, Power Query, Jupyter Notebook, ELT Pipelines, Web Scraping 🎓 Education Master of Information Technology (Software Engineering) – Federation University, Adelaide Bachelor of Engineering (Electronics & Communication) – Gujarat Technological University 🤝 Why Work With Me? I combine strong technical skills with an eye for business strategy. Whether you need ad hoc analysis, full-scale dashboard implementation, or help aligning data systems with your KPIs, I bring proactive communication, clean code, and on-time delivery to every project. I’m available to take on freelance projects, both short and long-term, and I'm happy to work across time zones. 📅 Ready to bring clarity to your data? Let’s connect and unlock your business insights. 📨 Message me today to discuss your project!

Pyspark
PySpark
pandas
Excel Formula
Excel Macros
Microsoft Excel PowerPivot
Python
SQL
Tableau
Microsoft Power BI
Power Query
Data Extraction
ETL
Data Analysis
$45 hourly
Sanjay J.
- 0.0/5
- (0 jobs)
As a Azure Data Engineer with 7+ years of experience in the tech world, I build and optimize enterprise data lake solutions to ingest and analyze large volumes of data from various vehicles. I leverage my expertise in Pyspark, Azure Databricks, Delta Lake, SQL, and other cloud technologies to ensure governance, cost management, security, storage, DevOps, and consumption design patterns. I work with a cross-functional team of data scientists, analysts, and engineers to deliver high-quality data products and insights to our clients. I have a strong background in data science and engineering, with a master's degree in Data Science from Monash University and previous experience in data warehouse development, ETL processes, Power BI reports, and machine learning models. I have a keen interest in applying advanced analytics and AI solutions to solve real-world problems and generate value. I am always looking for data science or data engineering challenges to learn new skills and techniques. I am a diligent, collaborative, and creative professional who strives for excellence and innovation.

Pyspark
Data Extraction
Data Mining
Microsoft Power BI
Machine Learning Model
Artificial Intelligence
GitHub
PySpark
Apache Airflow
Machine Learning
ETL
Azure DevOps
SQL
Python
$30 hourly
Nabila N.
- 4.8/5
- (4 jobs)
🏅Microsoft Certified Professional with 5+ years of experience 💼 Worked for Sydney's Top-most Fin-Tech provider. Currently working as a Data Engineer in a data solutions and consulting firm. 📊 I specialize in transforming complex data into actionable insights using Power BI, Excel and advanced forecasting techniques. My Background: I come from a Computer Science and Engineering background and I excel in transforming complex data into actionable insights using the latest tools and best practices. I am an advanced Power BI user, proficient in Excel (including VBA, Power Query, and Power Pivot) and SQL. I am also skilled in ETL processes (SSIS) as well as data cleansing and analysis with Python. Key Skills: 💡 Power BI: Harnessing the full potential of Power BI with Advanced DAX and Efficient data models for creating compelling visualizations and insightful dashboards. 💡 Excel: Expert user of Power Query, Power Pivot and advanced Excel functionalities, including VBA and Macros. 💡 Database: Proficient in SQL. Hands-on experience working in Microsoft SQL Server Management Studio. Previously maintained data pipelines from various sources using SSIS to data warehouse based in the Google Cloud Platform. 💡 Programming Excellence: Python (Pandas, NumPy, Matplotlib, Scipy, Scikit-learn), Java, VBA 💡 Forecasting: Recently completed the Forecasting Expert course, specializing in automated forecasting models. Utilizes three-step models including Level Calculation, Trend Analysis, and Seasonality, with a keen focus on accuracy metrics like BIAS, MAE, and RMSE. Achievements: 📊 Led successful financial performance analysis, budgeting, forecasting, and inventory & SCM analysis. 🤖 Introduced automation to forecasting models, ensuring accuracy and efficiency. 🎯 Transformed raw data into actionable insights for a leading Fin-Tech provider. Why Choose Me? 📈 Expert in Power BI and Excel, offering unparalleled data visualization and analysis. 💻 Adept at blending technical skills with a strategic mindset. 🤝 Adept team player and skilled planner. Let's collaborate to elevate your data game and drive meaningful results! 💼⚡🔼

Pyspark
Dashboard
Budgeting & Forecasting Software
Data Visualization
Microsoft Excel
Business Intelligence
Power Query
Microsoft Certified Professional
Databricks Platform
Data Engineering
PySpark
Python
ETL
SQL
Microsoft Power BI
Data Analysis
$30 hourly
Jimmy Z.
- 0.0/5
- (0 jobs)
I’m a Data Engineer with a decade of experience in the field. I have extensive expertise in database management, particularly with Oracle, MySQL, SQL Server, and DB2. My skill set includes designing and optimizing data warehouses, executing complex ETL processes, and performing data migrations with precision. I’m highly proficient in working with big data platforms, including HDFS, Spark, Hive, and Impala. I have a solid understanding of Oozie for workflow scheduling and Python for scripting and automating tasks. My focus is always on building scalable, efficient data pipelines that ensure data integrity and support robust analytics. I’m passionate about leveraging technology to solve complex data challenges and continuously exploring new tools and methodologies to stay ahead in the ever-evolving landscape of data engineering.

Pyspark
Unix Shell
Big Data
Data Modeling
Apache Hadoop
PySpark
Data Engineering
Data Migration
Data Warehousing & ETL Software
Python
Data Analysis
Data Extraction
ETL
Want to browse more freelancers?
Sign up