Hire the best Apache Spark specialists
Check out Apache Spark specialists with the skills you need for your next job.
- $99 hourly
- 5.0/5
- (16 jobs)
AWS RDS | MySQL | MariaDB | Percona | Semarchy xDM | AWS Glue | PySpark | dbt | SQL Development | Disaster Recovery | Business Continuity | ETL Development | Data Governance / Master Data Management | Data Quality Assessments | Appsheet | Looker Studio | Percona PMM *** Please see my portfolio below.*** I have over two decades of experience immersed in a variety of data systems oriented roles on both cloud-based and on-premise platforms. Throughout my career, I have served in senior-level roles as Data Architect, Data Engineer, Database Administrator, and Director of IT. My technology and platform specialties are diverse, including but not limited to AWS RDS, MySQL, MariaDB, Redshift, Percona XtraDB Cluster, PostgreSQL, Semarchy xDM, Apache Spark/PySpark, AWS Glue, Airflow, dbt, Amazon AWS, Hadoop/HDFS, Linux (Ubuntu, Red Hat). My Services Include: Business Continuity, High Availability, Disaster Recovery: Ensuring minimal downtime of mission-critical databases by utilizing database replication, clustering, and backup testing and validation. Performance Tuning: I can analyze the database configuration, errors and events, physical resources, physical table design, and SQL queries to address performance issues. Infrastructure Engineering: In the AWS environment I use a combination of Ansible, Python with the boto3 SDK, as well as the command line interface (CLI) to create and manage a variety of AWS services including EC2, RDS, S3, and more. System Monitoring: Maintaining historical performance metrics can be useful for proactive capacity planning, immediate outage detection, alerting, and analysis for optimization. I can use tools including Percona Monitoring & Management (PMM), and AWS tools such as Performance Insights and CloudWatch. ETL Development: I develop data processing pipelines using Python, Apache Spark/PySpark, and dbt. For process orchestration, I utilize AWS Glue or Airflow. I am experienced in integrating a variety of sources including AWS S3, REST API's, and all major relational databases. Data Governance / Master Data Management: I am experienced in all phases of development and adminstration on the Semarchy xDM Master Data Management Platform. - Building the infrastructure and installing the software in AWS. - Entity design. - Developing the UI components for use by the data stewards to view and manage master data. - Creating the internal procedures for data enrichment, validation, and duplicate consolidation. - Data ingestion (ETL) - Dashboard creation.Apache Spark SpecialistsDatabase ManagementLooker StudioData LakeApache AirflowAWS GluePySparkAmazon RDSdbtSystem MonitoringMaster Data ManagementHigh Availability and Disaster RecoveryMySQLMariaDBDatabase AdministrationSQL Programming - $40 hourly
- 5.0/5
- (12 jobs)
I am a developer focused on providing highly efficient software solutions. - Full Stack Developer - Data ScientistApache Spark SpecialistsApache SparkClouderaCakePHPApache HBaseApache HadoopLaravelPythonPHPMongoDBJavaScript - $500 hourly
- 4.6/5
- (17 jobs)
I excel at analyzing and manipulating data, from megabytes to petabytes, to help you complete your task or gain a competitive edge. My first and only language is English. My favorite tools: Tableau, Alteryx, Spark (EMR & Databricks), Presto, Nginx/Openresty, Snowflake and any Amazon Web Services tool/service (S3, Athena, Glue, RDS/Aurora, Redshift Spectrum). I have these third-party certifications: - Alteryx Advanced Certified - Amazon Web Services (AWS) Certified Solutions Architect - Professional - Amazon Web Services (AWS) Certified Big Data - Specialty - Amazon Web Services (AWS) Certified Advanced Networking - Specialty - Amazon Web Services (AWS) Certified Machine Learning - Specialty - Databricks Certified Developer: Apache Spark™ 2.X - Tableau Desktop Qualified Associate I'm looking for one-time and ongoing projects. I especially enjoy working with large datasets in the finance, healthcare, ad tech, and business operations industries. I possess a combination of analytic, machine learning, data mining, statistical skills, and experience with algorithms and software development/authoring code. Perhaps the most important skill I possess is the ability to explain the significance of data in a way that others can easily understand. Types of work I do: - Consulting: How to solve a problem without actually solving it. - Doing: Solving your problem based on your existing understanding of how to solve it. - Concept: Exploring how to get the result you are interested in. - Research: Finding out what is possible, given a limited scope (time, money) and your resources. - Validation: Guiding your existing or new team is going to solve your problem. My development environment: I generally use a dual computer-quad-monitor setup to access my various virtualized environments over my office fiber connection. This allows me to use any os needed (mac/windows */*nix) and also to rent any AWS hardware needed for faster project execution time and to simulate clients' production environments as needed. I also have all tools installed in the environments which make the most sense. I'm authorized to work in the USA. I can provide signed nondisclosure, noncompete and invention assignment agreements above and beyond the Upwork terms if needed. However, I prefer to use the pre-written Optional Service Contract Terms www [dot] upwork [dot] com/legal#optional-service-contract-terms.Apache Spark SpecialistsCI/CDSystems EngineeringGoogle Cloud PlatformDevOpsBigQueryAmazon Web ServicesWeb ServiceAmazon RedshiftETLDockerPredictive AnalyticsData ScienceApache SparkSQLTableau - $50 hourly
- 4.6/5
- (62 jobs)
DataOps Leader with 20+ Years of Experience in Software Development and IT Expertise in a Wide Range of Cutting-Edge Technologies * Databases: NoSQL, SQL Server, SSIS, Cassandra, Spark, Hadoop, PostgreSQL, Postgis, MySQL, GIS Percona, Tokudb, HandlerSockets (nosql), CRATE, RedShift, Riak, Hive, Sqoop * Search Engines: Sphinx, Solr, Elastic Search, AWS cloud search * In-Memory Computing: Redis, memcached * Analytics: ETL, Analytic data from few millions to billions of rows and analytics on it, Sentiment analysis, Google BigQuery, Apache Zeppelin, Splunk, Trifacta Wrangler, Tableau * Languages & Scripting: Python, php, shell scripts, Scala, bootstrap, C, C++, Java, Nodejs, DotNet * Servers: Apache, Nginx, CentOS, Ubuntu, Windows, distributed data, EC2, RDS, and Linux systems Proven Track Record of Success in Leading IT Initiatives and Delivering Solutions * Full lifecycle project management experience * Hands-on experience in leading all stages of system development * Ability to coordinate and direct all phases of project-based efforts * Proven ability to manage, motivate, and lead project teams Ready to Take on the Challenge of DataOps I am a highly motivated and results-oriented IT Specialist with a proven track record of success in leading IT initiatives and delivering solutions. I am confident that my skills and experience would be a valuable asset to any team looking to implement DataOps practices. I am excited about the opportunity to use my skills and experience to help organizations of all sizes achieve their data goals.Apache Spark SpecialistsPythonScalaETL PipelineData ModelingNoSQL DatabaseBigQueryApache SparkSphinxLinux System AdministrationAmazon RedshiftPostgreSQLETLMySQLDatabase OptimizationApache Cassandra - $100 hourly
- 5.0/5
- (44 jobs)
I have over 4 years of experience in Data Engineering (especially using Spark and pySpark to gain value from massive amounts of data). I worked with analysts and data scientists by conducting workshops on working in Hadoop/Spark and resolving their issues with big data ecosystem. I also have experience on Hadoop maintenace and building ETL, especially between Hadoop and Kafka. You can find my profile on stackoverflow (link in Portfolio section) - I help mostly in spark and pyspark tagged questions.Apache Spark SpecialistsMongoDBData WarehousingData ScrapingETLData VisualizationPySparkPythonData MigrationApache AirflowApache SparkApache KafkaApache Hadoop - $50 hourly
- 5.0/5
- (8 jobs)
A Backend Software Engineering with more than 6 years of experience. Have worked with large-scale backend/distributed systems and big data systems. A DevOps engineer with 4 years of experience - both on-premises and AWS, experienced with K8s, Terraform, Ansible, CI/CD. Currently working as Principal Engineer/ Solution Architect role.Apache Spark SpecialistsArchitectural DesignGraphQLServerless ComputingAmazon Web ServicesDevOpsAPI DevelopmentElasticsearchApache KafkaScalaApache SparkDockerApache HadoopKubernetes - $55 hourly
- 5.0/5
- (43 jobs)
I focus on data engineering, software engineering, ETL/ELT, SQL reporting, high-volume data flows, and development of robust APIs using Java and Scala. I prioritize three key elements: reliability, efficiency, and simplicity. I hold a Bachelor's degree in Information Systems from Pontifícia Universidade Católica do Rio Grande do Sul as well as graduate degrees in Software Engineering from Infnet/FGV and Data Science (Big Data) from IGTI. In addition to my academic qualifications I have acquired a set of certifications: - Databricks Certified Data Engineer Professional - AWS Certified Solutions Architect – Associate - Databricks Certified Associate Developer for Apache Spark 3.0 - AWS Certified Cloud Practitioner - Databricks Certified Data Engineer Associate - Academy Accreditation - Databricks Lakehouse Fundamentals - Microsoft Certified: Azure Data Engineer Associate - Microsoft Certified: DP-200 Implementing an Azure Data Solution - Microsoft Certified: DP-201 Designing an Azure Data Solution - Microsoft Certified: Azure Data Fundamentals - Microsoft Certified: Azure Fundamentals - Cloudera CCA Spark and Hadoop Developer - Oracle Certified Professional, Java SE 6 Programmer My professional journey has been marked by a deep involvement in the world of Big Data solutions. I've fine-tuned my skills with Apache Spark, Apache Flink, Hadoop, and a range of associated technologies such as HBase, Cassandra, MongoDB, Ignite, MapReduce, Apache Pig, Apache Crunch and RHadoop. Initially, I worked extensively with on-premise environments but over the past five years my focus has shifted predominantly to cloud based platforms. I've dedicated over two years to mastering Azure and I’m currently immersed in AWS. I have a great experience with Linux environments as well as strong knowledge in programming languages like Scala (8+ years) and Java (15+ years). In my earlier career phases, I had experience working with Java web applications and Java EE applications, primarily leveraging the WebLogic application server and databases like SQL Server, MySQL, and Oracle.Apache Spark SpecialistsScalaApache SolrApache KafkaApache SparkBash ProgrammingElasticsearchJavaProgress ChefApache FlinkApache HBaseApache HadoopMapReduceMongoDBDocker - $35 hourly
- 5.0/5
- (26 jobs)
Seasoned data engineer with over 11 years of experience in building sophisticated and reliable ETL applications using Big Data and cloud stacks (Azure and AWS). TOP RATED PLUS . Collaborated with over 20 clients, accumulating more than 2000 hours on Upwork. 🏆 Expert in creating robust, scalable and cost-effective solutions using Big Data technologies for past 9 years. 🏆 The main areas of expertise are: 📍 Big data - Apache Spark, Spark Streaming, Hadoop, Kafka, Kafka Streams, Trino, HDFS, Hive, Solr, Airflow, Sqoop, NiFi, Flink 📍 AWS Cloud Services - AWS S3, AWS EC2, AWS Glue, AWS RedShift, AWS SQS, AWS RDS, AWS EMR 📍 Azure Cloud Services - Azure Data Factory, Azure Databricks, Azure HDInsights, Azure SQL 📍 Google Cloud Services - GCP DataProc 📍 Search Engine - Apache Solr 📍 NoSQL - HBase, Cassandra, MongoDB 📍 Platform - Data Warehousing, Data lake 📍 Visualization - Power BI 📍 Distributions - Cloudera 📍 DevOps - Jenkins 📍 Accelerators - Data Quality, Data Curation, Data CatalogApache Spark SpecialistsSQLAWS GluePySparkApache CassandraETL PipelineApache HiveApache NiFiApache KafkaBig DataApache HadoopScalaApache Spark - $55 hourly
- 4.2/5
- (33 jobs)
Unlock Scalable Solutions with a Seasoned Data Engineer & Multi-Cloud Architect Are you looking for a professional who can transform complex data challenges into efficient, scalable solutions across various cloud platforms? With over 10 years of experience in data engineering and cloud architecture, I specialize in creating robust infrastructures that propel businesses forward, whether on AWS, Azure, Google Cloud, or others. 🚀 What I Bring to the Table: - Multi-Cloud Mastery (AWS, Azure, GCP): Expert in designing and deploying scalable architectures using leading cloud providers. I optimize cloud environments for performance and cost-efficiency, tailored to your preferred platform. - Advanced Python Development: Proficient in building high-performance applications and automation scripts. My Python expertise ensures your projects are delivered with clean, maintainable code. - API Development Expertise: Skilled in creating efficient and secure APIs that enable seamless integration and communication between your services and applications. - Containerization & Orchestration: Experienced with Docker and Kubernetes, I deploy, scale, and manage applications effortlessly across clusters for optimal performance. - In-Memory Data Solutions: Implementing caching and in-memory data storage to accelerate application responsiveness and handle high-throughput workloads effectively. - Machine Learning Pipelines: Proficient in integrating machine learning models into production environments, helping businesses make data-driven decisions with scalable ML workflows. 🌟 Why Work With Me: - Versatile Problem Solver: My multi-cloud expertise allows me to tackle complex challenges with innovative solutions, regardless of the platform. - Independent & Collaborative: Whether leading a project solo or collaborating with your team, I adapt to meet your needs effectively. - Transparent Communication: I believe in keeping you informed at every stage, ensuring transparency and trust throughout our collaboration. - Results-Oriented: My focus is on delivering tangible results that align with your business objectives. --- 📈 Let's Turn Your Vision into Reality Ready to elevate your project's infrastructure and performance across any cloud platform? Let's have a conversation about how my expertise can contribute to your success. Click the 'Invite' button, and let's get started!Apache Spark SpecialistsPySparkAPIAWS LambdaAmazon Web ServicesETL PipelineApache SparkPythonScrapyAmazon S3Data MiningAWS GlueApache AirflowDevOpsDockerData Migration - $200 hourly
- 4.9/5
- (86 jobs)
A full-stack engineer with a background that lends itself to helping companies stay lean and connected whilst scaling up their customers and services. With 7 year's experience in providing DevOps solutions and services to Finance, Web3.0 and Data Analytics - I have been heavily involved in building scalable platforms for microservices on Kubernetes, migrating infrastructure and services to the cloud and creating build environments for growing teams of developers. Skills: Cloud migrations - AWS, Azure, GCP, DigitalOcean, on-premise, Hetzner Container orchestration - Kubernetes (k8s) Rancher, Docker Swarm, OpenShift Infra-as-code - Pulumi, Terraform, CloudFormation, Sceptre Continuous delivery/integration - Jenkins, DroneIO, Helm, Kubernetes, GoCD, Tilt, Earthly Database - Elasticsearch, MongoDB, MySQL, MSSSQL, Postgres Applications - Docker, Nginx, LAMP, CoreOS, Terraform, Tableau, MS Exchange, Nutanix, VMWare Horizon/vCenter, Kafka, Atlassian Jira/Confluence, Microsoft SQL Server, Microsoft Exchange CloudFormation, Hugo Networking: DNS, DHCP, VLANs, NAT, Cisco Switch/Firewall Languages: Strong - PowerShell, Bash, Python, YAML, JSON Intermediate - GoLang, NodeJS, JavaScript, HTML, CSS, C#, TSQL Basic - Haskel, OCaml, Rust Achievements (in the last 2 years): - Re-engineered SAAS architecture - migrating all production to microservices on Kubernetes reducing the company's total software expenditure by 40% - Developed Terraform templates to make an automated multi-cloud disaster recovery solution - Implemented build pipelines to allow developers to work with isolated and identical versions of dev, test, and prod - Product Owner and Scrum Master of an Agile software development project for iPhone app - Advocate the need for a transparent business vision by employing OKRs and helped to align cascading team OKRs down through the organisation - Automated the provisioning of on-premise Kubernetes clusters and build pipelines using Matchbox, Bash and Helm templating Qualifications and education: 2020 - Kubernetes Certified Applications Developer 2020 - Kubernetes Certified Administrator 2018 - AWS Certified Developer Associate 2018 - Agile Certified Practitioner 2008 - 1st class degree in Electronic Engineering and Cybernetics Please get in touch to if you think my background can be helpful to you.Apache Spark SpecialistsApache SparkGrafanaAmazon ECSKubernetesDocker ComposeAmazon ECS for KubernetesContinuous IntegrationDockerJenkinsAmazon Web ServicesDevOpsTerraformMicrosoft Azure - $60 hourly
- 5.0/5
- (36 jobs)
✅ AWS Certified Solutions Architect ✅ Google Cloud Certified Professional Data Engineer ✅ SnowPro Core Certified Individual ✅ Upwork Certified Top Rated Professional Plus ✅ The author of Python package for cryptocurrency market Currency.com (python-currencycom) Specializing in Business Intelligence Development, ETL Development, and API Development with Python, Apache Spark, SQL, Airflow, Snowflake, Amazon Redshift, GCP, and AWS. Accomplished lots of complicated and not very projects like: ✪ Highly scalable distributed applications for real-time analytics ✪ Designing data Warehouse and developing ETL Pipelines for multiple mobile apps ✪ Cost optimization for existing cloud infrastructure But the main point: I have a responsibility for the final result.Apache Spark SpecialistsData ScrapingSnowflakeETLBigQueryAmazon RedshiftBig DataData EngineeringCloud ArchitectureGoogle Cloud PlatformETL PipelinePythonAmazon Web ServicesApache AirflowSQLApache Spark - $25 hourly
- 5.0/5
- (3 jobs)
Around 5 years’ of experience in Data Engineering with diversified tools and technologies. Experienced in transforming raw data into meaningful insights, ensuring data quality and integrity, and optimizing data processes for efficient analysis. Knowledge & hands-on experience of working in Cloud stack such as Azure, AWS , GCP and cloud agnostic layers like (Snowflake and Databricks). Experience in design & development of ETL jobs using SSIS, Airflow, Prefect, Nomad and Informatica. Worked on Microsoft BI Product Family namely SSIS (SQL Server Integration Services), and SSRS (SQL Server Reporting Services). Excellent problem-solving skills with strong technical background having the ability to meet deadlines, work under pressure and quickly master new technologies and skills. Working experience on Agile based development models with CI/CD pipelines. Proficient in coordinating and communicating effectively with project teams, with the ability to work both independently and collaboratively. I am very dedicated to provide Analytics Solutions to the companies and help them grow their business through extracting out meaningful information from their data. I firmly believe that through application of machine learning and data science techniques to the business nowadays can be very beneficial for its growth in this competitive materialistic market.Apache Spark SpecialistsData AnalysisGoogle Cloud PlatformNomadApache AirflowData ManagementApache NiFiApache ImpalaApache HiveSnowflakeBig DataClouderaMachine LearningPythonSQLInformaticaApache Spark - $60 hourly
- 5.0/5
- (7 jobs)
Senior Software Engineer with 7 years of experience in functional programming, machine learning, AI & BigData. Also got front-end experience building websites and tools.Apache Spark SpecialistsFunctional ProgrammingReactBig DataApache KafkaAkkaApache CassandraAmazon DynamoDBDatabricks PlatformMachine LearningApache SparkPythonScalaJavaScript - $35 hourly
- 4.6/5
- (1 job)
Data Engineer with extensive experience in building large scale Data Warehouse, Data Lake and Data Pipeline with Cloud native approach. In my pervious projects, I have worked on; Hadoop Ecosystem / Big Data Tools: • Apache Spark, Airflow, Cloudera Impala, Hive, Cassandra, Snowflake, AWS Tools: • EC2, S3, EMR, Athena, Secrets Manager, Lambda, Redshift, RDS, Glue Azure Tools: • VM, Blob Storage, ADLS, HDI, Synapse, Databricks Databases: • Oracle PL/SQL, PostgreSQL, MySQL, T-SQL Programming/Scripting: • Java, Python, Scala, BashApache Spark SpecialistsApache AirflowPySparkData ManagementApache SparkAmazon Web ServicesCloud ComputingBig DataETLData ExtractionETL PipelineSQLData ScrapingPython - $110 hourly
- 4.7/5
- (59 jobs)
Distributed Computing: Apache Spark, Flink, Beam, Hadoop, Dask Cloud Computing: GCP (BigQuery, DataProc, GFS, Dataflow, Pub/Sub), AWS EMR/EC2 Containerization Tools: Docker, Kubernetes Databases: Neo4j, MongoDB, PostgreSQL Languages: Java, Python, C/C++Apache Spark SpecialistsMapReduceApache KafkaCloud ComputingApache HadoopWhite Paper WritingAcademic WritingGoogle Cloud PlatformDaskApache SparkResearch Paper WritingApache FlinkKubernetesPythonJava - $30 hourly
- 4.5/5
- (70 jobs)
🏆 𝗧𝗢𝗣 𝗥𝗔𝗧𝗘𝗗 𝗣𝗟𝗨𝗦 - among the top 3% talent on Upwork 🏆 ⭐️ 𝟒𝟖+ happy clients ⭐️ 𝟑𝟎𝟎𝟎+ hours clocked With over 7 years of experience, I offer an unparalleled blend of expertise in data engineering and full stack development. My comprehensive skill set enables me to deliver robust technical solutions that drive business growth and operational efficiency. 𝗘𝘅𝗽𝗲𝗿𝘁𝗶𝘀𝗲 Big Data Solutions: Proven proficiency in Cloudera Hadoop, Denodo, Spark, Impala, Hive, Flink, Airflow, Kafka, and Nifi. I design and implement scalable big data solutions to manage and analyze large datasets effectively. ETL Implementation: Extensive experience with Informatica Cloud (IICS), Informatica BDM, SSIS, Talend, and Fivetran, facilitating seamless data extraction, transformation, and loading processes. Cloud Technologies: Advanced knowledge of cloud platforms including AWS (Redshift, Glue, Data Pipeline, S3, EMR), Microsoft Azure (Data Factory, Synapse Analytics, Databricks), and Google Cloud Platform (Big Query, Dataproc). I architect and implement cloud-based data solutions to enhance data accessibility and scalability. Data Warehousing and Analytics: Expertise in Data Modeling, Reporting (SSRS), Data Analysis (Pandas), Data Cleaning, Visualization, and Pre-Processing. Proficient with BI tools such as Power BI, Tableau, and Google Data Studio to convert data into actionable insights. Computer Vision: Specialized skills in Convolutional Neural Networks for advanced computer vision tasks including pose recognition, multi-object detection, and human tracking. Generative AI / LLMs / NLP: Expertise in smart chatbots development, LLM Finetuning & Optimization, custom AI agents development, automation solutions for internal workflows & SaaS applications and large scale AI Infrastructure Development. Mobile & Web Applications: Delivered over 30 mobile and web applications utilizing native and cross-platform technologies, including React Native and the MERN stack. My work includes developing custom solutions tailored to specific business needs. Frontend Technologies: Expertise in JavaScript, React Native, React JS, Next JS, HTML, CSS, Material UI, and Tailwind CSS. I focus on creating intuitive and responsive user interfaces that enhance user experience. Backend Technologies: Proficient in Node JS, Nest JS, Express, AWS, MongoDB, Firebase, and MySQL. I develop robust backend systems to support scalable and secure applications. API & Microservices: Skilled in designing and implementing token-based RestFul API servers and microservices architectures to ensure seamless integration and scalability. Project Delivery: A track record of delivering projects on time with 100% client satisfaction. I adhere to strict deadlines to ensure timely project completion without compromising quality. 𝗪𝗵𝗮𝘁 𝗜 𝗢𝗳𝗳𝗲𝗿 Custom Development: Tailored mobile and web application development with a focus on cross-platform solutions and user-centric design. Data Solutions: Comprehensive data engineering services including ETL processes, cloud data architecture, and advanced analytics to optimize data usage and drive business decisions. Integration & Support: Backend development, database integration, third-party API integration, quality assurance, and post-launch support to ensure seamless operation and performance. 𝗡𝗼𝘁𝗮𝗯𝗹𝗲 𝗖𝗹𝗶𝗲𝗻𝘁𝘀 & 𝗣𝗿𝗼𝗷𝗲𝗰𝘁𝘀 I have had the privilege of working with esteemed clients such as OnePlan, GoPlay, ActiveMentor AI, and Tribe Me, delivering solutions across diverse sectors including fitness, real estate, e-commerce, and fintech. 𝗖𝗼𝗻𝘁𝗮𝗰𝘁 To discuss how my expertise can contribute to your business objectives, please connect with me for a complimentary 30-minute consultation. 𝗛𝗶𝗴𝗵𝗹𝗶𝗴𝗵𝘁𝗲𝗱 𝗦𝗸𝗶𝗹𝗹𝘀: Full Stack Development | Full Stack Web Development | Full Stack Mobile Development | Application Development | Front-end Development | Back-end Development | SaaS Development | Android App developement | iOS Development | AI Chatbot Development | CMS Development | AI Integration | Crypto Wallet Development | Desktop Software Development | Ecommerce Website Development | Shopify | Shopify Apps | Mobile App Development | Mobile Game Development | Scripting & Automation | Mobile Design | UX/UI Design | Web Design | Smartphone | Database Development | JavaScript (JS) | TypeScript | React (React.js, ReactJS) | React Native (ReactNative) | Node.js (Node, NodeJS) | Next JS (Next.js) | Nest JS | Python | Scala | Pyspark | Django | Flask | Laravel | Vue.js | Swift | Kotlin | PHP | Flutter | Azure DevOps | Azure App service | Deployment Automation | Amazon Web Services (AWS) | Amazon EC2 | Firebase | MongoDB | MySQL | PostgreSQL | API Integration | OpenAI API | Generative AI Modeling | Machine Learning | Data Analytics | Data Visualization | A/B Testing | Data Extraction | Data ProcessingApache Spark SpecialistsETL PipelineAWS GlueDatabricks PlatformData Warehousing & ETL SoftwareData EngineeringNode.jsWeb DevelopmentReact NativeMobile App DevelopmentSnowflakePythonBigQuerySQLData Visualization - $350 hourly
- 5.0/5
- (34 jobs)
"Michael is just FANTASTIC. He is by far the best freelancer I have worked with over the past four years. He makes the process so seamless." Ranked in the top 1% of freelancers, member of the Upwork vetted expert program, and over 12 years experience. Please reach out to me for any of your AI/ML & Data Science Needs. Please see modelforge.ai for more information.Apache Spark SpecialistsLarge Language ModelVisual Basic for ApplicationsModelingForecastingChatGPTNatural Language ProcessingMachine LearningPython Scikit-LearnMicrosoft ExcelSQLApache SparkTensorFlowPython - $67 hourly
- 4.9/5
- (65 jobs)
Experienced Full-Stack Developer specializing in building robust web applications using JavaScript, Python, Java, or GoLang. I excel in both front-end and back-end development, with a strong focus on delivering scalable, efficient, and high-quality solutions. Ready to tackle your next project with a commitment to excellence and timely delivery.Apache Spark SpecialistsBig DataTerraformAWS GlueDjangoGolangGoogle Cloud PlatformGitGraphQLDevOpsJavaScriptReactFlaskMachine LearningPython - $60 hourly
- 5.0/5
- (16 jobs)
I’m a software developer with over 10 years of experience building Java back-end for websites and data processing tools. Also have experience working with AWS (EMR, Lambda, DynamoDB, S3, Redis), SQL and no-SQL databases (Neo4j). Currently working as a BigData developer (Spark, AWS). Additional languages: UkrainianApache Spark SpecialistsUnit TestingBig DataAPIMachine LearningSoftware Architecture & DesignAWS LambdaPythonSpring FrameworkJava - $30 hourly
- 5.0/5
- (9 jobs)
My background is diverse, yet I specialize in data mining, data scraping, data analytics, data visualization, Machine Learning, Web development, and a minor Blockchain. I possess a proven track record of success. In addition, I am a personable, reliable, highly skilled individual with over 10 years of experience in data science, artificial intelligence, and web development. With experience, I also bring in a large collection of pre-build applications and artificial intelligence models that would help you minimize your time to market and make it more cost-efficient. My primary services include, but are not limited to: 🟠 DATA ENGINEERING ✓ Analyzing and organizing raw data ✓ Building data systems and pipelines ✓ Evaluating business needs and objectives ✓ Interpreting trends and patterns ✓ Preparing data for prescriptive and predictive modeling ✓ Building algorithms and prototypes ✓ Developing analytical tools and programs 🟠 MACHINE LEARNING ENGINEERING ✓ Designing ML systems, Researching and implementing ML algorithms and tools ✓ Selecting appropriate data sets ✓ Picking appropriate data representation methods ✓ Identifying differences in data distribution that affects model performance ✓ Run machine learning tests and experiments ✓ Perform statistical analysis and fine-tuning using test results ✓ Train and retrain systems when necessary ✓ Extend existing ML libraries and frameworks 🟠 WEB DEVELOPMENT ✓ Building and maintaining web applications ✓ Assessing the efficiency and speed of current applications ✓ Managing hosting environments ✓ Troubleshooting and debugging ✓ Database creation, integration, and management ✓ Back-end frameworks to build server-side software and API integration ✓ Cloud computing integration ✓ Content management system development, deployment, and maintenance ✓ Security settings and hack prevents ✓ Reporting—generating analytics and statistics ✓ Backup and restore technologies for a website’s files and DB ✓ QA testing 🟠 BLOCKCHAIN ✓ Designing, developing, and testing blockchain systems. ✓ Developing application functionality using various coding languages. ✓ Writing efficient and modular code. ✓ Setting security measures against various types of cyber-crimes. ✓ Utilizing cryptography techniques to protect against hackers and other cyber attacks. ✓ Preparing documentation on the blockchain development processes.Apache Spark SpecialistsData AnalysisMySQLApache HadoopDockerDjangoMicrosoft AzureArtificial IntelligenceDatabricks PlatformSQLPythonPyTorchNatural Language Processing - $30 hourly
- 4.7/5
- (5 jobs)
I am a Full Stack Developer and Software Architect with 15 years of experience across various domains, including data science and data engineering. Throughout my career, I have designed, developed, and deployed successful products in diverse business domains. My specialties include: Enterprise Resource Planning Systems: HR, Payroll, Office Inventory, Warehouse, and Complaint Management. Information Retrieval: Extracting data from heterogeneous data marts in Law Enforcement, Medical Records, Social Media Platforms, and the Dark Web. Web Scraping: Data collection from Educational Sites, B2B Consumer Sites, and Social Media Platforms. Real-Time Analytics and Business Intelligence: Utilizing stream processing technologies like Apache Storm, Spark, and Kafka. Cyber Security: Expertise in SIEM, OSINT, and Dark Web monitoring. NLP, NLI, and Text/Video Analytics: Leveraging deep learning and traditional machine learning techniques. EdTech Platforms: Developing B2B and B2C educational technology solutions. B2B Price Comparison: Building platforms for comparative analysis in business-to-business markets. Technical Skills: Backend: PHP, Laravel, Django, Flask, Fast API, Node.js Frontend: HTML, CSS, JavaScript, jQuery, React.js, Next.js Databases: MySQL, MongoDB, Elasticsearch Messaging Queues: RabbitMQ, Apache Kafka Architecture: Monolithic, Microservices Applications, Event Driven Applications Cloud: AWS, GCP Big Data Tools: Apache Spark, Apache Storm, Hadoop, Google Big Query, Cloud Data Flow My extensive experience and diverse skill set make me well-equipped to handle complex projects and deliver innovative solutions. Let's collaborate to bring your project to life!Apache Spark SpecialistsHTMLDjangoReactjQueryMySQLMongoDBNext.jsPHPPySparkMachine LearningElasticsearchPythonApache AirflowApache KafkaApache Spark - $35 hourly
- 5.0/5
- (20 jobs)
Hi there! If you're visiting my page, perhaps you're looking for a professional. I'm a software developer, programmer, and tech lead with 7 years of experience in the industry. My strong sides are responsibility, attention to client's needs, strong will to achieve the final results of team efforts. I've been working with various programming languages and platforms. My favor is Python for the last 6 years. Also been experienced with JS, PHP, Android, Java, Dart. It's enough comfortable for me to work both in the team and stand-alone development. I can do IT =)Apache Spark SpecialistsWeb DevelopmentRESTful ArchitectureAngularAndroidBlockchainRaspberry PiDjangoReactMachine LearningJavaScriptTensorFlowPython - $25 hourly
- 5.0/5
- (20 jobs)
Hello there! I'm an experienced Cloud Data Engineer and Data Architect with 8 years of industry expertise. I specialize in leveraging cloud technologies to design robust data solutions that drive efficiency and unlock valuable insights. Let's collaborate to transform your data into a strategic asset for your business.Apache Spark SpecialistsPython ScriptData IngestionCloud ComputingData ExtractionData WarehousingBig DataData LakeMicrosoft AzurePySparkData MigrationApache SparkDatabricks PlatformData EngineeringSQLETL Pipeline - $275 hourly
- 5.0/5
- (111 jobs)
I understand my rate is higher than most, and that's because I bring extensive experience working with companies like Google, Meta, Reddit & hundreds of start ups. My goal is to make sure your investment in development leads to growth and success. Shoot me a message, and we’ll schedule a call to discuss your project Here's what I've worked with Languages & Frameworks: Swift, Kotlin, React, React Native AI & Machine Learning: Expertise in OpenAI API, LLM, and Diffusion Models Mobile Development: Custom iOS and Android apps built with Swift, Kotlin, and React Native. Web Development: Responsive and dynamic web applications using React and Node.JS. Backend Solutions: Robust backend development with Node.JS Cloud Integration: Seamless integration with AWS and Google Cloud services. AI Integration: Leveraging AI and machine learning models to enhance your applications.Apache Spark SpecialistsRokuApple TV ApplicationSmart TVFigmaHigh Fidelity DesignJavaAndroidReact NativeAndroid App DevelopmentFirebaseSwiftAmazon Web ServicesNode.jsMobile App DevelopmentiOS Development - $100 hourly
- 5.0/5
- (137 jobs)
— TOP RATED PLUS Freelancer on UPWORK — EXPERT VETTED Freelancer (Among the Top 1% of Upwork Freelancers) — Full Stack Engineer — Data Engineer ✅ AWS Infrastructure, DevOps, AWS Architect, AWS Services (EC2, ECS, Fargate, S3, Lambda, DynamoDB, RDS, Elastic Beanstalk, AWS CDK, AWS Cloudformation etc.), Serverless application development, AWS Glue, AWS EMR Frontend Development: ✅ HTML, CSS, Bootstrap, Javascript, React, Angular Backend Development: ✅ JAVA, Spring Boot, Hibernate, JPA, Microservices, Express.js, Node.js Content Management: ✅ Wordpress, WIX, Squarespace Big Data: ✅ Apache Spark, ETL, Big data, MapReduce, Scala, HDFS, Hive, Apache NiFi Database: ✅ MySQL, Oracle, SQL Server, DynamoDB Build/Deploy: ✅ Maven, Gradle, Git, SVN, Jenkins, Quickbuild, Ansible, AWS Codepipeline, CircleCI As a highly skilled and experienced Lead Software Engineer, I bring a wealth of knowledge and expertise in the areas of Java, Spring, Spring Boot, Big Data, MapReduce, Spark, React, Graphics Design, Logo Design, Email Signatures, Flyers, Web Development (HTML, CSS, Bootstrap, JavaScript & frameworks, PHP, Laravel), responsive web page development, Wordpress and designing, and testing. With over 11 years of experience in the field, I have a deep understanding of Java, Spring Boot, and Microservices, as well as Java EE technologies such as JSP, JSF, Servlet, EJB, JMS, JDBC, and JPA. I am also well-versed in Spring technologies including MVC, IoC, security, boot, data, and transaction. I possess expertise in web services, including REST and SOAP, and am proficient in various web development frameworks such as WordPress, PHP, Laravel, and CodeIgniter. Additionally, I am highly skilled in Javascript, jQuery, ReactJs, AngularJs, Vue.Js, and Node. C#, ASP.NET MVC In the field of big data, I have experience working with MapReduce, Spark, Scala, HDFS, Hive, and Apache NiFi. I am also well-versed in cloud technologies such as PCF, Azure, and Docker. Furthermore, I am proficient in various databases including MySQL, SQL Server, MySql, and Oracle. I am familiar with different build tools such as Maven, Gradle, Git, SVN, Jenkins, Quickbuild, and Ansible.Apache Spark SpecialistsApache SparkDatabaseWordPressCloud ComputingSpring FrameworkData EngineeringNoSQL DatabaseReactServerless StackSolution Architecture ConsultationSpring BootDevOpsMicroserviceAWS FargateAWS CloudFormationJavaCI/CDAmazon ECSContainerization - $15 hourly
- 4.8/5
- (168 jobs)
🌟🏆 TOP-RATED DEVELOPER 🏆🌟 Elevate your projects to new heights with excellence and finesse. ✨ Exquisite Workmanship: Crafting masterpieces with precision and passion. ✨ Budget-Conscious Solutions: Maximizing value without compromising quality. ✨ Exceptional Communication: Seamless dialogue for perfect collaboration. ✨ Seasoned Expertise: Seven years of refined mastery at your service. ✨ Committed to Your Success: Building enduring relationships built on trust and achievement. As your senior full-stack web developer, I'm dedicated to surpassing your expectations. Discover the realms of my expertise: 🔹 Frontend Wizardry: AngularJS, Vue JS, WordPress, ReactJS/Redux, Bootstrap, JavaScript, TypeScript, jQuery, Ajax, HTML5, Material UI, TailwindCSS. 🔹 Backend Brilliance: NodeJS, ExpressJS, PHP, Laravel, CakePHP, YiiWordPress, Python, Django, Flask, RESTful API, GraphQL. 🔹 Mobile App Magic: React-Native, Ionic, Flutter, Apache Cordova, IoT, Socket.io, iOS & Android. 🔹 Database Mastery: MongoDB, PostgreSQL, MongoDB, MySQL. 🔹 Designing Delight: UI/UX, Photoshop, Adobe XD, Adobe Illustrator, Corel Draw. Equipped with adeptness in project management tools like Asana, Jira, Trello, Sl@ck, BaseCamp, etc., I ensure flawless teamwork and remarkable project delivery. Let's create something extraordinary together! Best Regards VaibhavApache Spark SpecialistsWordPressMachine LearningSymfonyYiiFlaskDjangoLaravelFlutterNode.jsAngularReactReact NativeAngularJSPython - $60 hourly
- 5.0/5
- (54 jobs)
✅ TOP RATED PLUS EXPERT (top 1% of performers on Upwork), specializing in mobile native and hybrid apps. (iOS, Android, React Native) ✅ 10+ years of experience building mobile software for clients like Apple, Facebook and more, I am the developer who will complete your project with the highest quality and satisfaction within the agreed upon timeframe. Developing good rapport with excellent communication is important to me and I guarantee 100% satisfaction!Apache Spark SpecialistsInteractive DesignUX & UIWeb ApplicationUX ResearchUI/UX PrototypingApple XcodeMobile UI DesignObjective-CFlutteriOS DevelopmentWebflowUser Experience StrategyMobile App DevelopmentSwiftReact Native Want to browse more freelancers?
Sign up
How it works
1. Post a job
Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.
2. Talent comes to you
Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.
3. Collaborate easily
Use Upwork to chat or video call, share files, and track project progress right from the app.
4. Payment simplified
Receive invoices and make payments through Upwork. Only pay for work you authorize.
How do I hire a Apache Spark Specialist on Upwork?
You can hire a Apache Spark Specialist on Upwork in four simple steps:
- Create a job post tailored to your Apache Spark Specialist project scope. We’ll walk you through the process step by step.
- Browse top Apache Spark Specialist talent on Upwork and invite them to your project.
- Once the proposals start flowing in, create a shortlist of top Apache Spark Specialist profiles and interview.
- Hire the right Apache Spark Specialist for your project from Upwork, the world’s largest work marketplace.
At Upwork, we believe talent staffing should be easy.
How much does it cost to hire a Apache Spark Specialist?
Rates charged by Apache Spark Specialists on Upwork can vary with a number of factors including experience, location, and market conditions. See hourly rates for in-demand skills on Upwork.
Why hire a Apache Spark Specialist on Upwork?
As the world’s work marketplace, we connect highly-skilled freelance Apache Spark Specialists and businesses and help them build trusted, long-term relationships so they can achieve more together. Let us help you build the dream Apache Spark Specialist team you need to succeed.
Can I hire a Apache Spark Specialist within 24 hours on Upwork?
Depending on availability and the quality of your job post, it’s entirely possible to sign up for Upwork and receive Apache Spark Specialist proposals within 24 hours of posting a job description.