Medical AI Engineer — Dental SLM Fine-tuning (QLoRA, Vision + Language Models)

Posted yesterday

Worldwide

Summary

Job Title: Medical AI Engineer — Dental SLM Fine-tuning (QLoRA, Vision + Language Models) Overview We are building a proprietary dental aligner AI system for a dental company client. The system uses two models running on-premise: DentalGemma 1.5 4B (vision) — reads intraoral photos and X-rays, outputs structured clinical JSON Qwen3 8B (language) — reads clinical findings and generates aligner treatment plans Both models need fine-tuning on our proprietary dataset of 16 annotated patient cases with before/after photos, X-rays, clinical notes, and doctor-written treatment plans. We have the data ready. We need someone to execute the fine-tuning pipeline. Scope of work Task 1 — DentalGemma fine-tuning Fine-tune DentalGemma 1.5 4B on our dental image dataset using QLoRA Input: intraoral photos + X-rays with annotated JSON labels Output: model that correctly identifies teeth in FDI notation, classifies malocclusion, crowding severity, and aligner suitability Deliver: merged model weights + GGUF Q4_K_M converted file Task 2 — Qwen3 8B fine-tuning Fine-tune Qwen3 8B on our SFT dataset using QLoRA Input: clinical findings JSON + doctor treatment plan pairs Output: model that generates treatment plans matching our doctor's clinical style Deliver: merged model weights + GGUF Q4_K_M converted file Task 3 — Evaluation and benchmarking Run both models on 5 held-out test cases Compare outputs against ground truth Provide accuracy report showing improvement over base models Task 4 — Documentation Clean Python training scripts committed to our private GitHub repo README with exact commands to reproduce training W&B training charts showing loss curves What we provide Private GitHub repo with full codebase 16 annotated patient records (photos, X-rays, treatment plans) HuggingFace account with model access RunPod/Vast.ai credits for GPU compute Clear JSON schema and SFT dataset format Daily availability for questions Required skills HuggingFace transformers, peft, trl, bitsandbytes QLoRA fine-tuning experience on vision-language models Experience with medical or domain-specific model fine-tuning Python, Git GGUF conversion with llama.cpp Nice to have Previous MedGemma or Gemma fine-tuning experience Dental or medical AI background Unsloth experience (faster training) Deliverables Fine-tuned DentalGemma GGUF file Fine-tuned Qwen3 8B GGUF file Evaluation report (5 test cases) Training scripts in GitHub W&B training charts To apply, please answer: Have you fine-tuned a vision-language model before? Which one? Have you used QLoRA with bitsandbytes on a 4B+ parameter model? What is your estimated timeline for Tasks 1 and 2? Share one relevant project from your portfolio

  • More than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Intermediate
    Experience Level
  • $19.00

    -

    $40.00

    Hourly
  • Remote Job
  • Ongoing project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
Artificial Intelligence
Activity on this job
  • Proposals:10 to 15
  • Last viewed by client:yesterday
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Dec 8, 2023
  • IND
    Dwarka3:43 PM
  • $850 total spent
    6 hires, 2 active
  • 63 hours
  • Sales & Marketing
    Small company (2-9 people)

Explore similar jobs on Upwork

Quantum Computing
Small n8n taskHourly‐ Posted 11 months ago
Artificial Intelligence
Machine Learning
Natural Language Processing
Automation
OpenAI API
n8n
AI Agent Development
AI Chatbot
Python
TensorFlow
MongoDB
Hugging Face
Whisper AI
ElevenLabs
Retrieval Augmented Generation

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo