iOS Systems Engineer — On-Device LLM Inference Runtime (Swift/C++, Metal, Core ML)
Worldwide
We're building an iOS inference runtime: LLMs running locally on iPhone, with models pushed, swapped and rolled back remotely from a fleet control plane. We need the engineer who builds it. Prototype-grade feasibility work, not production polish. What you'll build A prototype iOS inference runtime (Swift + C/C++), evaluating Core ML and Metal pathways An on-device agent: registration, chunked/resumable/integrity-verified model download, load/swap/rollback, telemetry A test harness app running scripted benchmark suites — latency, memory, thermal state, energy impact — on real devices via AWS Device Farm Must have Strong iOS systems development: Swift with C/C++ interop, memory management under iOS constraints Hands-on Metal compute or Core ML (ideally opinions about both) On-device ML deployment — you've shipped or seriously prototyped models running on iPhones Familiarity with llama.cpp, MLX, Core ML Tools, GGUF quantisation, or similar Nice to have BGTaskScheduler / background-execution expertise MetricKit and energy/thermal instrumentation Model conversion and quantisation SDK or embeddable-framework experience
- More than 30 hrs/weekHourly
- 1-3 monthsDuration
- IntermediateExperience Level
$20.00
-
$50.00
Hourly- Remote Job
- Ongoing projectProject Type
Skills and Expertise
Activity on this job
- Proposals:50+
- Last viewed by client:yesterday
- Interviewing:3
- Invites sent:0
- Unanswered invites:0
About the client
- GBRCardiff5:11 PM
- $38K total spent9 hires, 2 active
- 537 hours
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by