iOS Systems Engineer — On-Device LLM Inference Runtime (Swift/C++, Metal, Core ML)

Posted 2 weeks ago

Worldwide

Summary

We're building an iOS inference runtime: LLMs running locally on iPhone, with models pushed, swapped and rolled back remotely from a fleet control plane. We need the engineer who builds it. Prototype-grade feasibility work, not production polish. What you'll build A prototype iOS inference runtime (Swift + C/C++), evaluating Core ML and Metal pathways An on-device agent: registration, chunked/resumable/integrity-verified model download, load/swap/rollback, telemetry A test harness app running scripted benchmark suites — latency, memory, thermal state, energy impact — on real devices via AWS Device Farm Must have Strong iOS systems development: Swift with C/C++ interop, memory management under iOS constraints Hands-on Metal compute or Core ML (ideally opinions about both) On-device ML deployment — you've shipped or seriously prototyped models running on iPhones Familiarity with llama.cpp, MLX, Core ML Tools, GGUF quantisation, or similar Nice to have BGTaskScheduler / background-execution expertise MetricKit and energy/thermal instrumentation Model conversion and quantisation SDK or embeddable-framework experience

  • More than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Intermediate
    Experience Level
  • $20.00

    -

    $50.00

    Hourly
  • Remote Job
  • Ongoing project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
macOS
Software Systems Engineering
Activity on this job
  • Proposals:50+
  • Last viewed by client:yesterday
  • Interviewing:
    3
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Nov 23, 2025
  • GBR
    Cardiff5:11 PM
  • $38K total spent
    9 hires, 2 active
  • 537 hours

Explore similar jobs on Upwork

Electrical Engineering
Computer Network
Embedded System
Electronics
Mechanical Design
Mechanical Engineering
Fire Protection Engineering

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo