Looker Studio Dashboard developer/Engineer (iPaaS, Python, BigQuery)
Worldwide
We are seeking an experienced data engineer/automation expert to build an end-to-end automated data pipeline. The goal is to ingest, standardize, and visualize heterogeneous text data from multiple external sources, creating a highly responsive, drill-down capable monitoring dashboard with real-time alerting. What We Have (Data Sources): The data is fragmented and comes from 2-3 channels. API Ingestion: Real-time or scheduled data fetching via third-party software APIs. Automated Scraping/Downloads: Webhook-based pushes or automated CSV/JSON exports from scraping tools. Data Dimensions: Platform source, publish time, raw text/content, engagement metrics (reach, likes), and metadata. What We Need to Achieve: Automated Ingestion (12-Hour SLA): Reliable extraction and aggregation from all sources every 12 hours without manual intervention. ETL & AI Tagging: Cleanse and standardize the heterogeneous data. BI Dashboard: Connect the database to a modern BI tool to visualize trends. Ideal Stack / Approach: We are open to your specific tool recommendations. We prioritize existed , cost-effective, and highly maintainable architectures. To Apply, Please Provide: A brief overview of the architecture/tools you would use to achieve this workflow. Examples of similar automated ETL + BI dashboard projects you have built.
- More than 30 hrs/weekHourly
- 6+ monthsDuration
- ExpertExperience Level
$30.00
-
$60.00
Hourly- Remote Job
- Ongoing projectProject Type
Skills and Expertise
Activity on this job
- Proposals:50+
- Last viewed by client:2 weeks ago
- Interviewing:0
- Invites sent:0
- Unanswered invites:0
About the client
- ChinaChengdu,China3:42 AM
- $3.5K total spent28 hires, 10 active
- 92 hours
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by