RunPod Serverless engineer for production GPU image generation

Posted 2 hours ago

Worldwide

Summary

Looking for proposals I’m running production GPU image generation on RunPod Serverless. The product needs pay-per-use scale-to-zero (workersMin = 0) and a cold path that is actually fast. Always-on workers are not not a solution, as the pipeline needs to be able to scale up and down as need be and sometimes that means everything parked (with ability for a quick restart) Stack (what you’ll touch) - Custom Docker GPU worker (our image, our handler/startup) - Multi-GB model weights on a network volume - Full product image-generation workflow (real customer path) - FlashBoot available So this is a real model + volume + serverless load problem, not an empty container demo. Stack weight (so expectations are right) This is a production image stack, not a light demo: multi-GB model weights on a network volume, custom GPU worker, and a full product generation path. Several pieces have to work together (assignment, volume load, startup, real gen). Treat it as a heavy cold-start / serverless problem, not a small “spin up an empty container and optimize a light model” job. Where things stand The stack exists and can generate (does fine when always on but moving to serverless). When a worker is already warm and the system is behaving, generation can be fine. We have not hit the finish line: true cold after scale-to-zero is not acceptably fast, and under min=0 we also see unreliable job assignment (jobs sitting while workers look available). We’ve tried some cold-start / startup changes on our side; however still running into issues. What needs to be resolved 1. Reliable job assignment and completion with min=0 2. Fast true-cold product generation after workers go to zero 3. Leave capacity at zero when you’re done What “done” means min=0 works, real product jobs complete, cold starts are fast enough for production use, and you can show how you verified it. Private details (IDs, model names, config) after hire. Who this is for People who have shipped RunPod Serverless cold starts with min=0 and large models / network volumes. Docker GPU workers, handler/startup work, debugging via API/console.

  • Not Sure
    Hourly
  • < 1 month
    Duration
  • Intermediate
    Experience Level
  • Remote Job
  • One-time project
    Project Type
Skills and Expertise
Mandatory skills
Docker
DevOps
Python
API Development
Activity on this job
  • Proposals:10 to 15
  • Last viewed by client:3 minutes ago
  • Interviewing:
    1
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Feb 11, 2022
  • United States
    San Diego11:12 AM
  • $3.6K total spent
    7 hires, 2 active
  • 106 hours

Explore similar jobs on Upwork

Add Tree Adoption Feature to WordPressFixed-price‐ Posted 2 months ago
WordPress
PHP
HTML5
CSS
Next.js
React
TypeScript
PostgreSQL
Vercel
Web Application
JavaScript
Node.js

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo