US-Qualified Commercial & Privacy Counsel — Designing Evaluations of AI Legal Work

We build evaluations that measure whether AI systems can perform substantive legal work to a standard a General Counsel would accept. We are engaging practising US-qualified lawyers to design and review them. Why the qualification requirement is specific This work turns on US law as it is actually applied: CCPA/CPRA and the state privacy regimes, US commercial contracting conventions, and the positions a US in-house team would take on third-party paper. Frameworks from other jurisdictions do not transfer cleanly — a task built on GDPR reasoning produces a different correct answer, and that is precisely where evaluations go wrong without anyone noticing. We are therefore engaging only lawyers admitted in a US jurisdiction, with US in-house or US practice experience. If you are qualified elsewhere, this posting is not a fit and we would rather say so plainly than waste your time. We expect to open equivalent engagements for other jurisdictions. What the engagement involves You would take a category of work you have done — a SaaS or vendor agreement review, a contract risk memo, a DPA or service-provider terms assessment, a regulatory change analysis, a DSAR scoping exercise — and build an evaluation task from it: - Construct a representative fact pattern and the document a reviewer would receive - Specify what a correct answer must establish, and what a plausible but wrong answer looks like - Review tasks written by other counsel and identify anything that would not survive GC or partner review The second and third points are the substance of the work. Defining a defensible wrong answer is considerably harder than defining a right one, and it is the part most evaluations get wrong. Who this suits - Commercial or in-house counsel — third-party paper review, clause deviation analysis, contract risk memos, escalation and approval judgment - Privacy counsel — CCPA/CPRA service-provider and vendor terms, DPA review, breach determination, DSAR scoping. CIPP/US welcome but not required - Regulatory or compliance counsel — assessing what a regulatory change actually requires a business to do differently This is not suited to litigators, or to private-practice associates who have not owned a commercial relationship after signature. Terms - Paid per completed task, $50–$250 depending on complexity and length - Ongoing rather than one-off, with steady volume for counsel whose work holds up in review - Entirely asynchronous and in writing — no meetings, no calls, no fixed hours - Around 10 hours a week if you want consistent volume; there is no minimum Confidentiality You would author from representative examples you construct yourself — never client matters, privileged material, personal data, or agreements you are obliged to protect. We will not ask you to reproduce anything you have worked on, and any task that appears to draw on a real matter is rejected. Please answer the questions below. We read every response. The question about the mistake a junior lawyer makes on this work tells us considerably more than a list of years and titles.