Speech-to-Text (STT) Engineer – Fine-Tune ASR Model for Bahasa Indonesia

Posted last week

Worldwide

Summary

# Speech-to-Text (STT) Engineer – Fine-Tune ASR Model for Bahasa Indonesia ## About the Project We are building a production-grade AI voice platform and are looking for an experienced **Speech-to-Text (ASR/STT) Engineer** to improve transcription quality for **Bahasa Indonesia**. The objective is to fine-tune an existing open-source STT model using high-quality Indonesian speech datasets to achieve strong real-world performance across conversational speech, phone calls, and AI voice interactions. This is a contract/freelance role with the possibility of continued work for additional languages. ## Responsibilities * Fine-tune an existing open-source Speech-to-Text model (Whisper, Canary, Parakeet, NeMo, wav2vec2, etc.) * Identify, clean, and prepare high-quality Bahasa Indonesia datasets * Perform dataset normalization, text cleaning, and preprocessing * Improve recognition for: * Conversational Indonesian * Regional accents * Numbers * Dates & times * Currency * Email addresses * URLs * Proper nouns * Optimize inference accuracy while maintaining low latency * Evaluate model performance using WER/CER and qualitative testing * Document the training process so it can be reproduced ## Required Skills * Strong experience with Speech-to-Text / Automatic Speech Recognition (ASR) * Experience training or fine-tuning models such as: * Whisper * NVIDIA NeMo * wav2vec2 * MMS * Canary * Parakeet * Other modern ASR models * Experience working with Hugging Face * PyTorch * Audio preprocessing and dataset preparation * Knowledge of Indonesian language datasets * Experience with multilingual ASR is a plus ## Nice to Have * Experience with telephony audio (8kHz) * Experience building production AI voice systems * Knowledge of punctuation restoration * Speaker diarization * Confidence estimation * Forced alignment * Noise robustness ## Deliverables * Fine-tuned Bahasa Indonesia STT model * Training scripts * Dataset preparation scripts * Evaluation report (WER/CER) * Inference scripts * Documentation for deployment ## Please Answer These Questions 1. Which STT models have you fine-tuned before? 2. Have you trained models specifically for Bahasa Indonesia? 3. Which Indonesian datasets have you worked with? 4. What WER improvements have you achieved on previous projects? 5. Which GPU infrastructure do you normally use? 6. How would you approach improving recognition of conversational Indonesian? 7. Have you worked with telephony (8kHz) audio? 8. Please share GitHub repositories, research papers, demos, or previous work. ## Ideal Candidate We are looking for someone who has already trained speech models for low-resource or multilingual languages and understands the full ASR pipeline—from dataset preparation to model training and production deployment. Strong communication and the ability to independently recommend datasets, training strategies, and evaluation methods are highly valued. If you've successfully delivered high-quality ASR models in production, we'd love to hear from you.

  • $1,500.00

    Fixed-price
  • Intermediate
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Automatic Speech Recognition
Activity on this job
  • Proposals:20 to 50
  • Last viewed by client:3 days ago
  • Interviewing:
    6
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Jun 17, 2026
  • USA
    New York1:40 PM
  • $20K total spent
    6 hires, 6 active

Explore similar jobs on Upwork

Python
Machine Learning
Artificial Intelligence
Artificial Neural Network
Natural Language Processing
Deep Learning
Neural Network
Deep Neural Network
Convolutional Neural Network
Salesperson for Quant Finance AI ModelHourly‐ Posted 4 weeks ago
Financial Modeling
Financial Analysis
Financial Projection
Financial Accounting

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo