Hire the best Apache Spark Engineers in Austin, TX
Check out Apache Spark Engineers in Austin, TX with the skills you need for your next job.
- $30 hourly
- 5.0/5
- (3 jobs)
I am a professional software developer and analyst. I got my MS from Georgia Tech in computer science and a BS from UT Austin in math. I mainly use Python, SQL, R, and Java.Apache Spark
Regression AnalysisStatistical AnalysisRHTMLTypeScriptSnowflakeTableauMachine LearningData AnalysisSQLJavaScriptGitJavaPython - $150 hourly
- 0.0/5
- (0 jobs)
8 Years of Expertise in Big Data, Cloud Technologies, and Advanced Analytics With eight years of extensive experience across data engineering, machine learning, and cloud technologies, I deliver innovative and scalable solutions tailored to diverse business needs. My expertise spans a wide range of tools, frameworks, and platforms, enabling me to manage complex data ecosystems and drive impactful insights. Core Technical Proficiencies: Programming and Scripting: > Mastery in Java, Scala, C, C#, Python, and JavaScript for building robust, scalable applications. > Advanced scripting capabilities with Bash, Shell, and tools like awk for process automation. Data Storage and Processing: > Distributed Storage: Expertise with Apache Hadoop (HDFS), Amazon S3, Azure Blob, and Google Cloud Storage. > Processing Frameworks: In-depth experience with Apache Spark, Flink, MapReduce, and Google Dataflow for batch and stream processing. > Data Lakehouses: Skilled in Snowflake, Databricks, Hive, and Delta Lake for modern analytics architecture. Databases and Data Models > SQL Databases: Extensive work with PostgreSQL, MySQL, Oracle, and MSSQL. > NoSQL Databases: Advanced proficiency in MongoDB, Cassandra, DynamoDB, and Aerospike. > Specialized Technologies: Amazon QLDB (ledger databases), Milvus and Chroma (vector databases), and graph solutions like Neo4j and JanusGraph. Real-Time Data and Messaging Systems > Proficient in setting up and managing Apache Kafka, RabbitMQ, and Amazon Kinesis for real-time data pipelines. > Expertise in distributed query engines like Presto, Trino, and Athena for high-performance data analytics. Data Integration and Transformation > Data Tools: Skilled in Logstash, Fluentd, and Talend for data ingestion and transformation. > File Formats: Comprehensive knowledge of Parquet, Avro, Delta, JSON, and other data formats. Machine Learning and Data Science > Advanced ML Techniques: Feature engineering, dimensionality reduction, and model optimization. > Algorithms: Expertise in Random Forest, Logistic Regression, SVM, and more. Tools and Platforms: Hands-on with MLflow, AWS SageMaker, and Jupyter for model development, training, and deployment. Visualization and Reporting > Dashboarding expertise with Tableau, Kibana, AWS QuickSight, and Looker for actionable insights and analytics reporting. Cloud and DevOps Proficiency > Cloud Platforms: Deep experience with AWS (Lambda, EMR, ECS), Google Cloud Platform, and Azure services. > DevOps Tools: Skilled in Docker, Kubernetes, Terraform, and ArgoCD for infrastructure management and deployment. Workflow Orchestration and Automation > Workflow Platforms: Expertise in Airflow, Prefect, and Oozie for efficient pipeline automation. Advanced AI and NLP Solutions > Proficiency in integrating OpenAI (GPT-4, LLMs), AWS Transcribe, and AWS Translate for AI-driven applications. > Specialized knowledge in RAG (Retrieval Augmented Generation) and AI-enabled data insights. Why Choose Me? > Broad Expertise: Comprehensive experience across modern data ecosystems ensures tailored, end-to-end solutions. > Scalable Solutions: Proven ability to deliver scalable and efficient systems for real-world business challenges. > Cutting-Edge Tools: Up-to-date knowledge and hands-on experience with the latest in big data, AI, and cloud technologies. > Collaborative Approach: A strong communicator and team player, committed to achieving your project’s goals efficiently. Let’s collaborate to transform your data challenges into opportunities. Get in touch to discuss your project today!Apache Spark
ArchitectureApache KafkaGenerative AINode.jsJavaPythonSQLNoSQL DatabasedbtETL PipelineMachine LearningArtificial IntelligenceApache FlinkDatabricks Platform Want to browse more freelancers?
Sign up
How hiring on Upwork works
1. Post a job
Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.
2. Talent comes to you
Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.
3. Collaborate easily
Use Upwork to chat or video call, share files, and track project progress right from the app.
4. Payment simplified
Receive invoices and make payments through Upwork. Only pay for work you authorize.
How do I hire a Apache Spark Engineer near Austin, TX on Upwork?
You can hire a Apache Spark Engineer near Austin, TX on Upwork in four simple steps:
- Create a job post tailored to your Apache Spark Engineer project scope. We’ll walk you through the process step by step.
- Browse top Apache Spark Engineer talent on Upwork and invite them to your project.
- Once the proposals start flowing in, create a shortlist of top Apache Spark Engineer profiles and interview.
- Hire the right Apache Spark Engineer for your project from Upwork, the world’s largest work marketplace.
At Upwork, we believe talent staffing should be easy.
How much does it cost to hire a Apache Spark Engineer?
Rates charged by Apache Spark Engineers on Upwork can vary with a number of factors including experience, location, and market conditions. See hourly rates for in-demand skills on Upwork.
Why hire a Apache Spark Engineer near Austin, TX on Upwork?
As the world’s work marketplace, we connect highly-skilled freelance Apache Spark Engineers and businesses and help them build trusted, long-term relationships so they can achieve more together. Let us help you build the dream Apache Spark Engineer team you need to succeed.
Can I hire a Apache Spark Engineer near Austin, TX within 24 hours on Upwork?
Depending on availability and the quality of your job post, it’s entirely possible to sign up for Upwork and receive Apache Spark Engineer proposals within 24 hours of posting a job description.