$60–150/hr · Mercor · Part time, 40 hours a week
A legal professional who writes problems, grades AI model legal output, and evaluates whether models correctly reason through legal issues.
What you would do
- Compose legal problems from matters you handled, including facts, forum, governing law, and reference answers for model grading
- Grade model-drafted contracts, motions, and legal opinions for accuracy and fitness of purpose
- Assess whether models correctly applied jurisdiction-specific legal standards and procedural rules
- Evaluate privilege assertions and confidentiality determinations under the governing law
- Flag strategic or analytical errors where law is stated correctly but application is flawed
Who they want
- Professional experience in legal practice, compliance, regulatory affairs, or policy work
- Clear written communication ability to explain legal reasoning and evaluation judgments
- Comfort with ambiguous evaluation criteria and willingness to raise unclear instructions
- Expertise across some combination of litigation, corporate law, IP, compliance, or regulatory domains
- Ability to work part-time on flexible projects with short notice
Main skills
What the interview asks about
1.Contract provision assessment
Models must draft provisions that do exactly what they are intended to do without creating unintended consequences. Spotting this requires understanding both the legal principle and the drafting craft.
For example: “A model drafts an IP provision restricting post-termination confidential use for 2 years. Your jurisdiction typically gives 3. Is this a legal error or defensible strategy?”
2.Citation accuracy and support
Models often cite authority correctly but for the wrong proposition. This error becomes critical in motion practice where citations are supposed to directly support each argument.
For example: “A model states evidentiary rules apply abuse-of-discretion standard in state court, then applies it to federal diversity. Would the strategy be wrong in federal court?”
3.Privilege and confidentiality judgment
Privilege determinations require forum-specific knowledge and fact pattern analysis. Models frequently either over-protect or under-protect communications.
For example: “A model claims CFO-auditor communications are attorney-client privileged. How would you evaluate whether the model identified the required relationship under your jurisdiction's privilege rules?”
4.Writing legal problems and solutions
Your reference answers define the standard that AI models are measured against. Poorly written problems or incomplete reference answers corrupt all downstream evaluation.
For example: “You handled a vendor breach dispute over late payment where your client invoked force majeure. How would you structure this as a formal legal problem?”
5.Forum-specific strategic evaluation
Even when legal analysis is technically correct, it can be strategically disastrous if it misunderstands the forum, judge, procedural rules, or standards of review that will actually apply.
For example: “A model's motion correctly cites the applicable summary judgment standard but structures the argument in a way that would fail in your jurisdiction's practice. How would you determine whether this is a reasoning error or just different strategic choices?”
A task you may get
Grade two AI legal outputs: a contract provision and motion section. Identify accuracy, citation support, and strategic flaws.
How to prepare
- Review recent decisions from your primary jurisdiction on substantive area where you have expertise
- Gather 2-3 examples of well-drafted contracts or motions from your own work to understand your drafting standards
- Practice explaining a complex legal judgment to a non-lawyer to develop your evaluation writing skills
- Think through a complex matter you handled and outline how you would structure it as a reference problem
The facts
- Pay
- $60–150/hr
- Hours
- Part time, 40 hours a week
- Where
- Remote
- Field
- Law
- Role type
- Talent network
- Posted
- 9/15/2026
We wrote this page from the public Mercor listing. It may be out of date, so read the full posting before you apply.