ML engineer wanted: self-host + fine-tune a Japanese LLM for structured tasks
Worldwide
We have an AI assistant feature in a web product, currently running on a commercial LLM API. It classifies user requests, triggers UI actions, fills forms from natural language, and answers questions from page content — in English and Japanese. We want to replace the external API with our own self-hosted, fine-tuned open model. Main reasons: cost control and data privacy (our Japanese users prefer data not going to third-party AI providers). What we need: • Pick the right open model — strong Japanese is a must. Our workload is mostly structured decisions and JSON output, not long-form writing, so we suspect a smaller model is enough — confirm or challenge that. • Set up hosting and give us honest monthly GPU cost numbers first — budget not yet fixed, we want a cheaper option and an ideal option. • Fine-tune it on our tasks — we provide the training data. • Prove it works — we have a test set recording how our current setup answers 100+ real queries. Your model must match it in both languages before we switch. • Stay on after launch for monitoring, retraining, and server upkeep — quote a monthly retainer. Tech context: Python backend with a retrieval pipeline and vector database, on cloud infrastructure in the Tokyo region. Full details shared after shortlisting under a mutual NDA. You'll coordinate with our existing developer, and should be comfortable with AI coding tools. I'm non-technical, so plain-language communication is important. To apply, skip the template. Just answer: (1) what model size do tasks like ours really need, and realistic monthly hosting cost? (2) how do you prove the new model matches our current quality before switching? Real answers get interviews — specifics shared under NDA.
- More than 30 hrs/weekHourly
- 6+ monthsDuration
- ExpertExperience Level
- Remote Job
- Ongoing projectProject Type
Skills and Expertise
Activity on this job
- Proposals:15 to 20
- Last viewed by client:yesterday
- Interviewing:0
- Invites sent:0
- Unanswered invites:0
About the client
- IndiaSurat6:44 AM
- $5.4K total spent23 hires, 5 active
- 143 hours
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by