Senior AI / Agentic-Infrastructure Engineer: need multi-agent development for projects at GPU scale

Posted yesterday

Worldwide

Summary

Good day! I'm a technical founder running several concurrent, high-complexity workstreams, from production AI systems to a deep-research group. I already work with AI coding agents, but I'm finding that I'm the bottleneck. I need someone far more advanced at multi-agent orchestration to build, or bring and customize, a production-grade "agentic development organization" that I plug my own GitHub, Anthropic/Claude (Claude Code), VS Code, and compute into, so I can run multiple agents and projects in parallel, coherently, and multiply my own output across everything I do. Optionally, you can also co-build alongside to accelerate delivery of certain projects (NDA required). I see this being two phases: Phase 1 — Build (or stand up) & teach me the agentic development organization A production-grade multi-agent setup I plug my own accounts/tools into: many agents in parallel, git worktrees, background/remote agents, agent fleets across multiple machines, orchestration, CI/CD + eval/test automation. Elastic GPU/CPU compute — provision and autoscale heavy compute (cloud based for now) so slow hardware stops being the bottleneck; cost controls built in. A shared memory + knowledge backbone (persistent state, retrieval, knowledge graph) so nothing is lost between sessions and work stays connected. A verification spine, the system's #1 job: many agents across many projects must compose into one coherent whole with a zero-defect standard (verification gates, no silent failures), not a swarm that drifts. Document everything and train me: I want a capability I own and can run solo, reusable across all my projects. No black boxes, no consultant-dependency. Phase 2 (optional): Co-building. Pair on non-core layers: installers/cross-platform packaging, dashboards, CI/devops, IDE integration, eval/benchmark harnesses, self-host deployment/hardening. All proprietary/IP details shared only after NDA + IP-assignment are signed. IP core stays in-house. Required skills: Multi-agent orchestration / agentic development — proven, hands-on. You've designed and operated systems where many AI agents work in parallel. Comfortable with Claude Code / agent SDKs, MCP, agent evals/guardrails. Compute & MLOps at scale: GPU/CPU orchestration + autoscaling (Kubernetes, Ray, Slurm, cloud GPU: AWS/CoreWeave/Runpod/Lambda), cost management. DevEx / automation — Git at scale (worktrees, branching), CI/CD, reproducible environments. Strong polyglot backend/systems, primarily Python (FastAPI); comfort with Go, TypeScript/Node, ideally C++/CUDA. Cloud + infra: AWS (ECS/Fargate, Lambda, ALB/CloudFront), Terraform/IaC, Postgres (+pgvector), Redis, containers, SSE. Memory infra: vector DB + graph DB or similar. Reliability & verification discipline: you can explain how you keep parallel agents coherent and correct, not just fast. Zero-gaps/zero-shortcuts is a design requirement. Required experience: - 5+ years professional engineering, including production AI/LLM infrastructure. - Demonstrated agentic/multi-agent orgs or pipelines: concrete, show-me examples (repos, demos, write-ups, talks). What you built vs. off-the-shelf. - Shipped ≥1 production, enterprise-grade system (security, reliability, deployment). - Bonus: GPU/CUDA or memory/performance work, LLM gateways/inference optimization, ML-research infra. - Track record of documenting and transferring complex setups (no dependency traps). Technology & access you must have: - Your own powerful hardware and/or cloud: ideally multiple machines; capable of heavy parallel agent + GPU workloads. - Your own Claude Code / agent tooling and model accounts for testing (BYO-key, incl. OpenRouter). - GPU access (cloud or local) for the performance portions, or a clear plan to provision it. - Confidentiality & IP (non-negotiable) NDA + full IP-assignment signed before any access to code, accounts, or product details (my counsel's templates; cross-border enforceability matters). - All work product and IP are mine; no reuse of any code/methods/concepts elsewhere. - Scoped, revocable access only; secure credential practices (no raw passwords; scoped tokens / supervised pairing); identity verification + references for anyone near the core. Engagement: Open to a custom build or customizing a platform you already own. Starts with a small paid trial task (stand up the Phase-1 environment), then milestone-based, with potential ongoing/long-term work. Budget is a placeholder and negotiable. How to apply (read carefully — proposals that skip this are ignored): 1. Show a real agentic/multi-agent system you built: repo, demo, write-up, or talk. What you built vs. used. 2. In 3–5 sentences: a multi-agent pipeline you ran in production, and one hard orchestration/coherence problem you solved. 3. Your hardware/compute + GPU access. 4. How you'd guarantee coherence and correctness across many parallel agents/projects, briefly. 5. Confirm you'll sign NDA + IP-assignment and start with a paid trial. Start your proposal with the word "AGENTIC" so I know you read this. Thank you for your time and reply. Looking forward to discussing more and working together!

  • Less than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Expert
    Experience Level
  • $50.00

    -

    $110.00

    Hourly
  • Remote Job
  • Complex project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
Python
Kubernetes
DevOps Engineering
Activity on this job
  • Proposals:50+
  • Last viewed by client:yesterday
  • Interviewing:
    2
  • Invites sent:
    5
  • Unanswered invites:
    3
About the client
Member since Mar 16, 2026
  • USA
    Ocoee7:02 PM
  • $3.8K total spent
    2 hires, 1 active
  • 45 hours

Explore similar jobs on Upwork

Chef and Helpers for Biryani and GraviesFixed-price‐ Posted 4 weeks ago
Cooking
Docker
DevOps
Linux System Administration

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo