AI Engineer

Posted last week

Only freelancers located in the U.S. may apply.U.S. located freelancers only

Summary

I’m looking for an AI Engineer to help build an AI Safety Evaluation & Governance product powered by open-source models. This is a 1-month, hands-on project with an expected commitment of around 20 hours per week. The goal is to build an MVP that can automatically test AI models, identify safety failures, analyze failure patterns, and support continuous improvement. 🔍 What you’ll work on • Build an automated red-teaming engine that generates test cases across risk domains, severity levels, and attack strategies • Run tests against models such as Gemma, Llama, Qwen, and API-based models • Develop evaluators for jailbreak success, policy violations, over-refusal, under-refusal, and severity • Structure safety policies into consistent taxonomies and evaluation criteria • Turn confirmed failures into reusable eval datasets and regression tests • Build lightweight reporting for model comparison, human review, and policy-version tracking 🧠 What I’m looking for • Experience with open-source LLMs, inference pipelines, prompt optimization, fine-tuning, LoRA/QLoRA, and LLM evaluation • Ability to independently build an end-to-end MVP, including data pipelines, model orchestration, scoring, and reporting • Familiarity with AI safety, red teaming, jailbreaks, content moderation, or Trust & Safety systems • Bonus: experience with model-based evaluators, human-in-the-loop review, agentic testing, or multimodal safety ⏳ Project setup Duration: 1 month Time commitment: Around 20 hours per week Format: Flexible and remote-friendly Stage: Early-stage, 0-to-1 MVP This is not about manually writing red-team prompts one by one. The goal is to build a scalable system that can continuously generate tests, evaluate model behavior, identify safety gaps, and verify whether issues have been resolved. If this sounds like you, please DM me with a brief introduction and examples of relevant work.

  • $5.00

    Fixed-price
  • Intermediate
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
LLM Prompt Engineering
Activity on this job
  • Proposals:10 to 15
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Apr 2, 2026
  • USA
    Austin1:01 PM

Explore similar jobs on Upwork

Test Automation Framework
ETL Pipeline
SQL
Automated Testing
Snowflake
Business Development Associate for StartupHourly‐ Posted 3 weeks ago
Agile Software Development
SAP
Marketing Automation
Marketing Strategy

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo