ML engineer wanted: self-host + fine-tune a Japanese LLM for structured tasks

Posted yesterday

Worldwide

Summary

We have an AI assistant feature in a web product, currently running on a commercial LLM API. It classifies user requests, triggers UI actions, fills forms from natural language, and answers questions from page content — in English and Japanese. We want to replace the external API with our own self-hosted, fine-tuned open model. Main reasons: cost control and data privacy (our Japanese users prefer data not going to third-party AI providers). What we need: • Pick the right open model — strong Japanese is a must. Our workload is mostly structured decisions and JSON output, not long-form writing, so we suspect a smaller model is enough — confirm or challenge that. • Set up hosting and give us honest monthly GPU cost numbers first — budget not yet fixed, we want a cheaper option and an ideal option. • Fine-tune it on our tasks — we provide the training data. • Prove it works — we have a test set recording how our current setup answers 100+ real queries. Your model must match it in both languages before we switch. • Stay on after launch for monitoring, retraining, and server upkeep — quote a monthly retainer. Tech context: Python backend with a retrieval pipeline and vector database, on cloud infrastructure in the Tokyo region. Full details shared after shortlisting under a mutual NDA. You'll coordinate with our existing developer, and should be comfortable with AI coding tools. I'm non-technical, so plain-language communication is important. To apply, skip the template. Just answer: (1) what model size do tasks like ours really need, and realistic monthly hosting cost? (2) how do you prove the new model matches our current quality before switching? Real answers get interviews — specifics shared under NDA.

  • More than 30 hrs/week
    Hourly
  • 6+ months
    Duration
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
AI Model Development
Python
Activity on this job
  • Proposals:15 to 20
  • Last viewed by client:2 hours ago
  • Interviewing:
    6
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Dec 17, 2020
  • India
    Surat5:12 PM
  • $5.4K total spent
    23 hires, 5 active
  • 143 hours

Explore similar jobs on Upwork

iOS
Camera
Android Smartphone
Artificial Intelligence
No-Code Platform for Multimodal ModelsFixed-price‐ Posted 6 days ago
Multimodal Large Language Model
Machine Learning
MLOps

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo