AI Dev to Build Auto Audio-to-Image Video Sync Tool (Python, FFmpeg, Vision AI)

Posted 12 hours ago

Worldwide

Summary

What I'm building An AI tool that takes a narration audio file + a folder of images and automatically outputs a video where the right image is shown for what's being said at each moment — with smooth zoom in/out and slide in/out motion (Ken Burns style), synced to the audio. Fully automatic, no manual scripting. A working prototype already exists and handles: audio-to-cut timing (cuts land in speech pauses, never mid-word), pacing (each image held for the full point), the zoom/slide animation, and rendering. So you're building on a foundation, not from scratch. The focus of this job — the core feature: Accurate, fully-automatic matching of images to narration — "the right picture for the right words," no random images. This means: • transcribe + understand the story from the audio (Whisper) • read each image with a vision-language model (Qwen2-VL / LLaVA / GPT-4o) so matches are by meaning, not shape/color similarity (CLIP alone is not enough) • match each narration moment to the correct image How we'll work: Start with a small paid trial — get accurate matching working on one 2–3 minute test scene first. If it works, we continue with the full feature. (Performance for long videos and server deployment can be follow-up phases.) Deliverables: working matching module integrated with the existing prototype + source code + a short setup note. To apply, please answer: Have you built with FFmpeg and vision-language models? Share examples/links. In 2–3 sentences: how would you approach the automatic image-to-audio matching? Are you open to a small paid trial scene first? Your availability.

  • $500.00

    Fixed-price
  • Expert
    Experience Level
  • Remote Job
  • Complex project
    Project Type
Skills and Expertise
Mandatory skills
Python
FFmpeg
Computer Vision
Activity on this job
  • Proposals:10 to 15
  • Last viewed by client:7 hours ago
  • Interviewing:
    3
  • Invites sent:
    5
  • Unanswered invites:
    1
About the client
Member since Aug 19, 2026
  • India
    11:29 PM

Explore similar jobs on Upwork

AI-Driven Graphic Design SpecialistHourly‐ Posted 4 weeks ago
Adobe Illustrator
Graphic Design
Illustration
Adobe Photoshop
Python
Machine Learning
Artificial Intelligence
Artificial Neural Network
Natural Language Processing
Deep Learning
Neural Network
Deep Neural Network
Convolutional Neural Network

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo