Agentic RLE Authors

Posted yesterday

Worldwide

Summary

We're hiring Agentic RLE Authors. Not prompt writers. Not annotators. Authors — people who build the evaluation environments that test whether AI agents behave safely during real coding tasks. You'll design complete, Dockerized scenario packages from scratch — task instructions, repository fixtures, reference solutions, and deterministic verifiers. What we're looking for: → Strong Python. You'll be writing real code — reference solutions, test harnesses, and containerized environments. Not pseudocode. → Security awareness. You understand how vulnerabilities actually work and how they're properly fixed vs. superficially patched. → Docker fluency. Building and validating self-contained environments should feel routine. → Trajectory review. You can read an agent's reasoning trace, spot where it went wrong, and figure out why. → The ability to think adversarially and constructively in the same sitting. → Experience with RLHF, AI evaluation, benchmark authoring, or red-teaming is a strong plus.

  • $40.00

    Fixed-price
  • Intermediate
    Experience Level
  • Remote Job
  • One-time project
    Project Type
Skills and Expertise
Python
Docker
Reinforcement Learning
Activity on this job
  • Proposals:5 to 10
  • Last viewed by client:18 hours ago
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Apr 22, 2026
  • IND
    Bangalore5:08 AM
  • $17K total spent
    4 hires, 4 active
  • 31 hours
  • Tech & IT
    Mid-sized company (10-99 people)

Explore similar jobs on Upwork

Data Labeling
Data Annotation
Notion
Claude
ChatGPT Prompt
Productivity Tool
India-Based Dermatologist for AI Content ReviewFixed-price‐ Posted 2 weeks ago
Healthcare

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo