Real-Time Guitar Chord & Note Recognition — On-Device Audio ML (Proof of Concept to Start)

Posted 2 weeks ago

Worldwide

Summary

I'm the founder of FretFlow, a guitar-learning app for beginners — a flowing, color-coded fretboard that shows you how to play the songs you love and slows down when you fall behind. The app is built and running on iPhone. I'm now building the feature at the heart of it, and I need a specialist for the one piece I can't build myself. THE WORK Build FretFlow's real-time audio recognition engine: it hears a guitar through the phone's microphone and identifies the chords and notes being played, live, on the device. I want to start with a small, paid PROOF OF CONCEPT — a working demo that recognizes guitar chords (and ideally individual notes) in real time from mic input. If it works and we work well together, it grows into the full engine and a longer contract. WHAT THE PROOF OF CONCEPT SHOULD SHOW - Live chord recognition from a guitar through a microphone, in real time - A clear path to running on-device on a phone (Core ML / TensorFlow Lite), low latency — not server-dependent YOU'RE A FIT IF YOU'VE: - Built audio/music ML focused on RECOGNITION — chord detection, pitch/note detection, music information retrieval (NOT music generation) - Run audio ML models ON a mobile device (Core ML, TensorFlow Lite, or ONNX) - Worked with real-time, low-latency audio NICE TO HAVE: React Native / Expo familiarity; tools like Essentia, librosa, CREPE, or basic-pitch; you play guitar. ABOUT THE STAGE Early-stage, founder-led, pre-launch. This is a paid contract starting with the proof-of-concept, with real room to continue. I'm looking for someone excited to build the brain of a product from the ground up. Please answer the screening questions below — proposals that show specific chord/pitch-recognition and on-device work go to the top of my list. 1. Have you built a chord or note/pitch recognition system before? Briefly describe it and share a link if you can. 2. Have you run an audio ML model on a mobile device (Core ML, TensorFlow Lite, or ONNX)? Which one, and roughly what latency did you get? 3. In a sentence or two, how would you approach real-time chord recognition from a phone's microphone?

  • Not Sure
    Hourly
  • 1-3 months
    Duration
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Core ML
Machine Learning
Activity on this job
  • Proposals:15 to 20
  • Last viewed by client:last week
  • Hires:
    1
  • Interviewing:
    4
  • Invites sent:
    3
  • Unanswered invites:
    1
About the client
Member since Jun 13, 2026
  • USA
    Lodi11:54 AM
  • $20 total spent
    1 hire, 0 active
  • Education
    Individual client

Explore similar jobs on Upwork

Gen AI Developer (Contract)Fixed-price‐ Posted 1 month ago
AI Agent Development
Python
JavaScript
API
Node.js
Deep Learning
React
PostgreSQL
Quantum Computing

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo