AI / Python Developer for Multi-Agent 3D Scanning & Analysis Workflow (Contract to Full-Time)

Posted 3 hours ago

Worldwide

Summary

Project Overview: We are an innovative startup based in Hong Kong building a fully automated, AI-driven pipeline to manufacture custom 3D-printed insoles. We are looking for a highly skilled technical partner to build out this platform in phases. This initial contract is for Phase 1 (Proof of Concept & Initial Workflow). If Phase 1 is successful, this role will transition into a long-term, full-time partnership to build out the remaining phases (CAD generation and 3D printing integration). Phase 1 Scope of Work: You will be responsible for building a multi-agent AI workflow that takes user-uploaded media, converts it into a 3D model, and extracts precise anatomical measurements. The specific workflow you will build: User Interface: A simple chat interface where a user can upload a video or a batch of images of their foot. Agent 1 (Vision & Orchestration): Receives the files and validates that there are enough angles/frames for a successful 3D scan. Sends the validated media to a 3D reconstruction API (e.g., Luma AI, Polycam, or similar). Retrieves the processed 3D mesh file (.obj or .ply). Saves the file to a database and passes the file path/context to Agent 2. Agent 2 (Data Analyst & Geometry): Uses Python 3D libraries (such as trimesh or open3d) to programmatically extract physical measurements from the 3D foot mesh (e.g., arch height, foot width, foot length). Generates 2D renders/snapshots of the 3D mesh. Passes these 2D renders to a Vision LLM (like GPT-4o or Claude 3.5 Sonnet) to visually analyze the foot and identify biomechanical traits like pronation or supination. (Note: We understand pressure points are difficult to map purely from a mesh without a pressure mat, so we are looking for your expertise on how to best estimate weight distribution based on arch type and foot shape). Required Skills & Experience: Python Programming: Strong backend Python skills. AI Agent Frameworks: Experience building multi-agent workflows using frameworks like CrewAI, LangGraph, AutoGen, or Dify. 3D Geometry / Computer Vision: Experience working with 3D meshes using libraries like trimesh, open3d, or pyvista. API Integrations: Experience integrating external APIs (OpenAI, Anthropic, Luma AI, etc.). Basic UI/UX: Ability to spin up a quick front-end (e.g., Streamlit, Gradio, or a basic React/Next.js app) to demonstrate the chat and upload interface. Future Phases (For the right long-term partner): Once Phase 1 is complete, future work will involve: Agent 3: Generating automated, professional podiatry reports based on the data. Agent 4 (CAD/CAM): Using parametric modeling (e.g., OpenSCAD, KittyCAD API) to automatically generate a 3D-printable .stl file of the custom insole based on Agent 2's measurements. To Apply, Please Answer the Following: Briefly describe how you would approach building Agent 1 (validating the images and interacting with a 3D API). Have you worked with 3D files (.obj, .stl, .ply) in Python before? If so, which libraries did you use? Which multi-agent framework (CrewAI, LangGraph, etc.) would you recommend for this specific workflow and why? Please provide a rough time and cost estimate for Phase 1 as described above

  • Less than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Intermediate
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Python
API
Machine Learning
Activity on this job
  • Proposals:50+
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Apr 8, 2024
  • Hong Kong
    Pokfulam6:47 PM
  • $2.1K total spent
    7 hires, 0 active
  • 8 hours
  • Tech & IT
    Small company (2-9 people)

Explore similar jobs on Upwork

Software DeveloperHourly‐ Posted 7 months ago
ASP.NET MVC
Django
Python
AngularJS
JavaScript
jQuery
WordPress
Google Chrome Extension
React
CRM Development
Microsoft Dynamics 365
Microsoft Dynamics CRM
Microsoft Dynamics Development
Microsoft PowerApps
Single Sign-On
Three.js
JavaScript
WordPress
AR Plugin
WooCommerce
3D Modeling

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo