AI Engineer
Only freelancers located in the U.S. may apply.U.S. located freelancers only
I’m looking for an AI Engineer to help build an AI Safety Evaluation & Governance product powered by open-source models. This is a 1-month, hands-on project with an expected commitment of around 20 hours per week. The goal is to build an MVP that can automatically test AI models, identify safety failures, analyze failure patterns, and support continuous improvement. 🔍 What you’ll work on • Build an automated red-teaming engine that generates test cases across risk domains, severity levels, and attack strategies • Run tests against models such as Gemma, Llama, Qwen, and API-based models • Develop evaluators for jailbreak success, policy violations, over-refusal, under-refusal, and severity • Structure safety policies into consistent taxonomies and evaluation criteria • Turn confirmed failures into reusable eval datasets and regression tests • Build lightweight reporting for model comparison, human review, and policy-version tracking 🧠 What I’m looking for • Experience with open-source LLMs, inference pipelines, prompt optimization, fine-tuning, LoRA/QLoRA, and LLM evaluation • Ability to independently build an end-to-end MVP, including data pipelines, model orchestration, scoring, and reporting • Familiarity with AI safety, red teaming, jailbreaks, content moderation, or Trust & Safety systems • Bonus: experience with model-based evaluators, human-in-the-loop review, agentic testing, or multimodal safety ⏳ Project setup Duration: 1 month Time commitment: Around 20 hours per week Format: Flexible and remote-friendly Stage: Early-stage, 0-to-1 MVP This is not about manually writing red-team prompts one by one. The goal is to build a scalable system that can continuously generate tests, evaluate model behavior, identify safety gaps, and verify whether issues have been resolved. If this sounds like you, please DM me with a brief introduction and examples of relevant work.
$5.00
Fixed-price- IntermediateExperience Level
- Remote Job
- Ongoing projectProject Type
Skills and Expertise
Activity on this job
- Proposals:10 to 15
- Interviewing:0
- Invites sent:0
- Unanswered invites:0
About the client
- USAAustin1:01 PM
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by