Cloudera(CDP) Data Engineer
Worldwide
I am looking for energetic , and trustful, dedicated freelance person, who want to build the better career ! Responsibilities: Design and build data pipelines to extract, transform, and load (ETL) large data sets from multiple sources into the Cloudera environment. Manage and optimize data infrastructure for high performance, reliability, and scalability across both on-premise and cloud environments. Develop and maintain scripts and workflows using Python, Java, Scala, or Pig to automate data processing and integration tasks. Collaborate with cross-functional teams to understand data requirements, develop solutions, and ensure data is accurate and available for analytics and reporting. Monitor and troubleshoot Cloudera environments, leveraging tools such as Cloudera Manager and Hue for system health, tuning, and debugging. Qualifications 3+ years of experience using Hadoop technologies (including Spark) to ingest, transform, and process data Experience with Cloudera installation, configuration, tuning, and administration Experience developing and managing NiFi pipelines for data ingestion and transformation Experience leveraging generative AI coding tools to assist in development Experience working in SQL (Hive, Spark SQL, or Impala) for querying and managing data within the Cloudera ecosystem Experience with public cloud platforms such as AWS or Microsoft Azure Knowledge of Python, Java, Scala, or Bash for data engineering and automation Experience with Terraform for infrastructure automation and deployment Experience with with CI/CD tools and DevOps best practices Knowledge of data governance, metadata management, and data catalog tools Ability to optimize queries and resource usage for better performance and efficiency
- More than 30 hrs/weekHourly
- 1-3 monthsDuration
- IntermediateExperience Level
- Remote Job
- Ongoing projectProject Type
Skills and Expertise
Activity on this job
- Proposals:10 to 15
- Interviewing:0
- Invites sent:0
- Unanswered invites:0
About the client
- United StatesNew York City12:54 PM
- Sales & MarketingIndividual client
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by