Senior iOS Computer Vision Engineer (AVFoundation + C++ OpenCV Optimization)
Worldwide
PROJECT OVERVIEW ==================================== We are building a local-first, native iOS utility application optimized for high-performance physical document and structural surface data ingestion. We are seeking an Expert Mobile Computer Vision Engineer to develop a standalone camera ingestion module responsible for real-time frame capturing, spatial matrix calculations, and coordinate output. Your sole responsibility is ensuring that a live video feed from an iPhone mounted on a desktop tripod can dynamically isolate a structured physical workspace grid, mathematically correct non-orthogonal perspective warps, and cleanly pass flat data arrays to our core application engine. You will NOT be building consumer UI, layout menus, or cloud database integrations. This is a low-level graphics, mathematics, and memory management milestone. CORE RESPONSIBILITIES & DELIVERABLES ==================================== 1. LOW-LATENCY INGESTION: Configure a robust, hardware-level frame buffer pipeline utilizing Apple’s AVFoundation framework to pull raw CMSampleBufferRef streams natively at a stable frame rate without triggering device thermal throttling. 2. GEOMETRIC NORMALIZATION: Implement real-time Homography algorithms and Perspective Warps using C++ OpenCV to instantly flatten a physical, square workspace grid captured from varying, skewed tripod angles. 3. TRANSIENT NOISE FILTERING: Establish logic frameworks to detect and filter out temporary occlusion (e.g., a hand passing over the workspace or placing an object on the surface), ensuring the underlying data ledger only registers permanent state updates. 4. SWIFT INTEROP BRIDGING: Construct highly optimized Objective-C++ wrappers or modern Swift/C++ Interop layers to pass the calculated tracking arrays seamlessly across to our master Swift core application state. TECHNICAL REQUIREMENTS ================================================================================ - Mastery of native iOS development (Swift & Objective-C++ Interop). - Strong production history with C++ (14 or higher) and OpenCV mobile compilation. - Deep expertise in Apple's AVFoundation, CoreVideo, and local pixel buffer manipulation. - Experience with Metal or CoreImage for custom GPU/hardware acceleration is a significant plus. - A strong foundation in linear algebra, matrix operations, and spatial tracking geometry. HOW TO APPLY ================================================================================ Please submit a brief summary detailing your specific experience with real-time video buffer manipulation or native mobile computer vision applications (e.g., advanced document scanners, spatial tracking tools, or AR components). Please explicitly mention your experience bridging native C++ codebases over to Apple’s Swift runtime environment.
$3,000.00
Fixed-price- ExpertExperience Level
- Remote Job
- Ongoing projectProject Type
Skills and Expertise
Activity on this job
- Proposals:5 to 10
- Last viewed by client:2 days ago
- Interviewing:6
- Invites sent:0
- Unanswered invites:0
About the client
- United StatesBurlingame4:52 PM
- $23K total spent7 hires, 0 active
- Individual client
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by