Records, eDiscovery & IT Asset Governance Professionals — Build Tests for AI

We're building tests that measure whether AI systems can actually do real information governance work — and we need people who do that work for a living to design them. Most AI benchmarks for this kind of work are written by people who have never scoped a litigation hold in Vault, applied a retention policy to the wrong OU and had to explain it, or reconciled a licence count that said the company was paying for 400 people who left. The result is tests that look impressive and prove nothing. We're trying to fix that, and it only works if the tasks come from people who have done the job. Scope is records and information governance plus IT asset and SaaS licence management: holds, retention, export and disposition, licence true-ups, shadow IT, and device compliance. What you'd actually do: - Take a piece of work you've genuinely done — a litigation hold scoping, a retention policy application, an export request, a licence true-up, a shadow-IT review — and turn it into a task an AI system has to attempt - Define what "correct" looks like, and just as importantly, what a plausible-looking wrong answer looks like - Review tasks other practitioners have written and flag anything that wouldn't survive legal or audit scrutiny The interesting part: you'll see exactly where these systems fall over on real work in your field. Most people guess about that. You'd know. Records disposition approval is safety-critical — approve the wrong thing and the data is gone. We want the tasks written by people who understand what that costs. This is not a one-off. We have over 10,000 tasks to work through and we're bringing on up to 100 practitioners to do it. Individual tasks pay between $50 and $250 depending on complexity, and there is steady ongoing work for people whose tasks hold up well. Who we're looking for: - Records and eDiscovery managers — litigation hold scoping in Vault or Purview, retention policy application by OU, export request scoping and delivery, records disposition approval. Google Vault, Microsoft Purview, Relativity - IT asset and SaaS licence managers — licence true-up against headcount, shadow-IT app review and allowlisting, device compliance exception handling. Intune, Jamf, Zluri, Torii, ServiceNow ITAM - Working inside a corporate IT, legal ops or GRC function - Able to write clearly enough that another practitioner could follow your task exactly - 10+ hours a week you can spend on this Important: you'd author from representative examples you construct yourself. Never real hold notices, custodian lists, exports, or licence data. Paid per task completed. We work with 100+ practitioners, so everything runs async and in writing — no meetings. To apply, answer the questions below. We read every answer — the question about junior mistakes matters more to us than your years of experience.