rPPG Extraction and Heart Rate Detection

Posted 4 weeks ago

Overview of the Project
We are seeking your expertise in developing a robust pipeline for the collection of remote
photoplethysmography (rPPG) signals and subsequent heart rate calculation.
The primary objective of this project is to collect highly accurate rPPG signals while
minimizing mean square error. The input sensor for signal collection will primarily be a
camera, with various specifications ranging from 2MP to 6MP or even a web streaming link
providing live streams. The parameters of these streams, including FPS (frames per second),
bitrate, height, width, and codecs, may vary significantly. Hence, it is imperative to build a
robust pipeline capable of controlling and standardizing these variables to ensure consistent
rPPG signal generation.

Key Tasks
1. Develop a Pipeline Control System: Design and implement a pipeline control system
capable of managing FPS variation, bitrate fluctuation, and stream dimension
variations. This system should be flexible enough to accommodate different camera
specifications and streaming sources.

2. Standardize Video Collection Pipeline: Create a standardized video collection pipeline
to ensure consistent rPPG signal generation across different camera types and
streaming sources. This pipeline should include procedures to account for variations
in lighting conditions, camera angles, and skin tone(PSNR).

3. Signal Processing for rPPG Extraction: (Supervised or unsupervised your perspective)
Develop algorithms for extracting rPPG signals from the collected videos. These
algorithms should prioritize accuracy and reliability while minimizing noise and
artifacts. A signal with low MSE high SNR values as well as Pearson correlation
coefficient beyond 0.90.

4. Heart Rate Calculation: Utilize the extracted rPPG signals to calculate heart rates
accurately. Ensure that the heart rate calculation algorithm accounts for variations in
signal quality and noise levels.

Expected Deliverables
1. Detailed design specifications for the pipeline control system and video collection

2. Implemented pipeline control system capable of managing FPS, bitrate, and stream

3. Standardized video/stream collection pipeline.

4. Signal processing algorithms for rPPG extraction.

5. Heart rate calculation algorithm integrated with the rPPG extraction module.

6. Comprehensive documentation outlining the implementation details, testing
procedures, and performance evaluation metrics.

  • US$1,800.00

  • Expert
    Experience level
  • Remote job
  • One-time project
    Project type
  • Contract-to-hire
    This job has the potential to turn into a full time role
Skills and expertise
Deep Learning Skills
Computer Vision Neural Network
Deep Learning Deliverables
Deep Learning
Heart rate rPPG Live Stream Customization
+ 5 more
Activity on this job
  • Proposals:
    5 to 10
  • Last viewed by client:
    4 days ago
  • Requested freelancers:
  • Interviewing:
  • Invites sent:
  • Unanswered invites:
About the client
Member since 4 May 2020
  • India
    Hyderabad 12:45
  • 28 jobs posted
    33% hire rate, 5 open jobs
  • US$26K total spent
    10 hires, 4 active
  • US$45.00 /hr avg hourly rate paid
    551 hours
  • Tech & IT
    Mid-sized company (10-99 people)

Explore similar jobs on Upwork

Vehicle damage recognition
Hourly ‐ Posted 22 hours ago
Python Machine Learning
Python Computer Vision Machine Learning TensorFlow

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft logo
  • Airbnb logo
  • Bissell logo
  • GoDaddy logo