AI Engineer to Build Self-Hosted AI Avatar Video Platform

Posted 2 weeks ago

Worldwide

Summary

I'm looking for an experienced AI engineer / ML engineer / full-stack developer to help build a self-hosted AI avatar video generation platform. I do not want this project to depend on third-party avatar APIs like HeyGen, D-ID, Synthesia, or similar platforms. The goal is to own the core technology stack as much as possible and avoid dependency on companies changing or deprecating their APIs. The platform should allow users to: Upload video footage to create/train a reusable AI avatar Upload an MP3 audio file Generate an MP4 video of the selected avatar speaking that audio Upload a photo and turn it into an animated/talking avatar Save and reuse multiple avatars Potentially scale this into a SaaS product later The ideal approach would be based on: Open-source AI video / talking-head / lip-sync models Self-hosted inference Cloud GPU or dedicated GPU infrastructure Custom training/fine-tuning where needed A full web app for uploading assets, managing avatars, processing jobs, and downloading final videos Architecture that can eventually support multiple users and paid SaaS accounts I am open to using open-source models and infrastructure providers, but I do not want the core product to rely on closed third-party avatar-generation APIs. For the first phase, I am looking for: Technical feasibility assessment Recommended open-source models and architecture MVP roadmap Infrastructure requirements GPU cost estimates Timeline and budget estimate Explanation of the limitations compared to tools like HeyGen Advice on how difficult it would be to turn this into a SaaS platform Please apply only if you have hands-on experience with at least some of the following: Talking-head generation Lip-sync models Video generation models Face animation Voice/audio-driven animation Diffusion models Computer vision PyTorch GPU deployment FastAPI / backend development SaaS architecture In your application, please include: Similar AI video/avatar projects you have built Which open-source models you would consider using Whether you recommend training custom avatars or using reference-based animation Expected quality limitations Estimated cost for an MVP Estimated processing cost per generated video What you would build first to validate the idea Important: I am not looking for a simple wrapper around existing avatar APIs. I want to explore building an independent, self-hosted avatar video generation system where the core generation pipeline is owned and controlled by us.

  • More than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Expert
    Experience Level
  • Remote Job
  • Complex project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
Artificial Intelligence
Activity on this job
  • Proposals:50+
  • Last viewed by client:2 weeks ago
  • Interviewing:
    1
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since May 3, 2025
  • Greece
    Athens10:58 AM
  • $950 total spent
    3 hires, 3 active

Explore similar jobs on Upwork

Software DeveloperHourly‐ Posted 8 months ago
ASP.NET MVC
Django
Python
AngularJS
JavaScript
jQuery
WordPress
Google Chrome Extension
React
CRM Development
Microsoft Dynamics 365
Microsoft Dynamics CRM
Microsoft Dynamics Development
Microsoft PowerApps
Single Sign-On
Three.js
JavaScript
WordPress
AR Plugin
WooCommerce
3D Modeling

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo