Medical AI Engineer — Dental SLM Fine-tuning (QLoRA, Vision + Language Models)

Posted yesterday

Worldwide

Summary

Job Title: Medical AI Engineer — Dental SLM Fine-tuning (QLoRA, Vision + Language Models) Overview We are building a proprietary dental aligner AI system for a dental company client. The system uses two models running on-premise: DentalGemma 1.5 4B (vision) — reads intraoral photos and X-rays, outputs structured clinical JSON Qwen3 8B (language) — reads clinical findings and generates aligner treatment plans Both models need fine-tuning on our proprietary dataset of 16 annotated patient cases with before/after photos, X-rays, clinical notes, and doctor-written treatment plans. We have the data ready. We need someone to execute the fine-tuning pipeline. Scope of work Task 1 — DentalGemma fine-tuning Fine-tune DentalGemma 1.5 4B on our dental image dataset using QLoRA Input: intraoral photos + X-rays with annotated JSON labels Output: model that correctly identifies teeth in FDI notation, classifies malocclusion, crowding severity, and aligner suitability Deliver: merged model weights + GGUF Q4_K_M converted file Task 2 — Qwen3 8B fine-tuning Fine-tune Qwen3 8B on our SFT dataset using QLoRA Input: clinical findings JSON + doctor treatment plan pairs Output: model that generates treatment plans matching our doctor's clinical style Deliver: merged model weights + GGUF Q4_K_M converted file Task 3 — Evaluation and benchmarking Run both models on 5 held-out test cases Compare outputs against ground truth Provide accuracy report showing improvement over base models Task 4 — Documentation Clean Python training scripts committed to our private GitHub repo README with exact commands to reproduce training W&B training charts showing loss curves What we provide Private GitHub repo with full codebase 16 annotated patient records (photos, X-rays, treatment plans) HuggingFace account with model access RunPod/Vast.ai credits for GPU compute Clear JSON schema and SFT dataset format Daily availability for questions Required skills HuggingFace transformers, peft, trl, bitsandbytes QLoRA fine-tuning experience on vision-language models Experience with medical or domain-specific model fine-tuning Python, Git GGUF conversion with llama.cpp Nice to have Previous MedGemma or Gemma fine-tuning experience Dental or medical AI background Unsloth experience (faster training) Deliverables Fine-tuned DentalGemma GGUF file Fine-tuned Qwen3 8B GGUF file Evaluation report (5 test cases) Training scripts in GitHub W&B training charts To apply, please answer: Have you fine-tuned a vision-language model before? Which one? Have you used QLoRA with bitsandbytes on a 4B+ parameter model? What is your estimated timeline for Tasks 1 and 2? Share one relevant project from your portfolio

  • More than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Intermediate
    Experience Level
  • $19.00

    -

    $40.00

    Hourly
  • Remote Job
  • Ongoing project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
Artificial Intelligence
Activity on this job
  • Proposals:10 to 15
  • Last viewed by client:yesterday
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Dec 8, 2023
  • IND
    Dwarka3:21 AM
  • $850 total spent
    6 hires, 2 active
  • 63 hours
  • Sales & Marketing
    Small company (2-9 people)

Explore similar jobs on Upwork

Quantum Computing
Artisan AI Optimization ExpertHourly‐ Posted 4 weeks ago
Adobe Illustrator
Graphic Design
Adobe Photoshop
Logo Design

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo