Mobile & Computer Vision Engineer: Refactor MediaPipe Real-Time Pose Tracking

Posted yesterday

Worldwide

Summary

We have a React Native mobile application that uses MediaPipe BlazePose keypoint estimation to track real-time human movement sequences and evaluate repetition counts for various physical movement patterns. Currently, our tracking engine suffers from coordinate jitter, frame-drop latency, and inaccurate state tracking (e.g., false-positive counts, partial movements triggering completion, or double-counting). We need an experienced Mobile / Computer Vision engineer to refactor our pose evaluation pipeline so tracking is rock-solid, smooth, and predictable. What You Will Be Working On: Keypoint Smoothing & Filtering: Implement spatial/temporal filtering (such as Exponential Moving Average or Low-Pass filtering) on raw landmark coordinates to eliminate noise before calculating joint vectors and angles. Hardened State Machine Architecture: Re-architect our movement evaluation using strict dual-threshold hysteresis (distinct entry/exit bounds), state duration guards, and landmark confidence filtering. Offline Testing Setup: Set up a clean local script/test harness using pre-recorded video feeds (clean movements, fast movements, partial movements) to log and verify state transitions frame-by-frame before running on-device. Required Experience: Strong proficiency in React Native (iOS/Android) and real-time camera/WebView performance optimization. Production experience with MediaPipe (BlazePose), OpenCV, or similar pose-estimation pipelines. Firm grasp of 3D vector geometry and Finite State Machine (FSM) software patterns. To Apply: Please describe your experience working with MediaPipe or pose-estimation frameworks, and briefly explain how you typically handle landmark jitter and false state triggers in real-time mobile applications.

  • Less than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Smartphone
Smartwatch
Mobile App Development
Activity on this job
  • Proposals:20 to 50
  • Last viewed by client:yesterday
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Aug 23, 2026
  • Cyprus
    1:01 AM

Explore similar jobs on Upwork

iOS
Android
iOS Development
Mobile App Development
Stripe
TypeScript
JavaScript
Smartphone
Tablet
React Native
iOS
Android
REST API

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo