Agentic RLE Authors
Worldwide
We're hiring Agentic RLE Authors. Not prompt writers. Not annotators. Authors — people who build the evaluation environments that test whether AI agents behave safely during real coding tasks. You'll design complete, Dockerized scenario packages from scratch — task instructions, repository fixtures, reference solutions, and deterministic verifiers. What we're looking for: → Strong Python. You'll be writing real code — reference solutions, test harnesses, and containerized environments. Not pseudocode. → Security awareness. You understand how vulnerabilities actually work and how they're properly fixed vs. superficially patched. → Docker fluency. Building and validating self-contained environments should feel routine. → Trajectory review. You can read an agent's reasoning trace, spot where it went wrong, and figure out why. → The ability to think adversarially and constructively in the same sitting. → Experience with RLHF, AI evaluation, benchmark authoring, or red-teaming is a strong plus.
$40.00
Fixed-price- IntermediateExperience Level
- Remote Job
- One-time projectProject Type
Skills and Expertise
Activity on this job
- Proposals:5 to 10
- Last viewed by client:18 hours ago
- Interviewing:0
- Invites sent:0
- Unanswered invites:0
About the client
- INDBangalore5:08 AM
- $17K total spent4 hires, 4 active
- 31 hours
- Tech & ITMid-sized company (10-99 people)
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by