$110–150/hr · Mercor · Full time, 40 hours a week
Senior finance domain expert who builds and validates AI training datasets that teach frontier models to reason like professional financial practitioners.
What you would do
- Review model outputs and finance work products for accuracy, reasoning rigor, and professional completeness
- Write detailed instruction specifications and model solutions that define financial correctness
- Design evaluation benchmarks that test whether the model understands real financial problems at professional depth
- Work with researchers to establish and enforce consistent calibration standards across finance tasks
- Identify missing behaviors and reasoning gaps, then design new training tasks to address them
Who they want
- 5+ years of dedicated finance work at a top-tier firm (investment bank, asset manager, PE fund, Big Four, corporate treasury, or regulator)
- Senior-level mastery in one core discipline: corporate finance and planning, M&A, wealth or asset management, credit, quantitative risk, treasury, or audit
- Clear progression to Vice President, Director, Principal, Portfolio Manager, Controller, or equivalent leadership role with real decision ownership
- Advanced degree (MBA, MS, PhD in finance or quantitative field) or professional credential (CFA, CPA, FRM, actuary) strongly preferred
- Hands-on use of large language models within your work context, plus the judgment to distinguish well-reasoned from plausible-sounding analyses
Main skills
What the interview asks about
1.Assessing model reasoning quality
The core of this role is spotting when a model answer looks superficially correct but misses material facts or reasoning a working professional would include. This tests whether you can discriminate plausible language from sound analysis.
For example: “Review a PE fund analysis of two acquisition targets with similar revenue but different balance sheets. The model's logic is coherent but glosses over working capital and refinancing risk. What would you flag and why would a partner care?”
2.Building specs from tacit knowledge
You need to convert years of implicit, on-the-job judgment into explicit written standards others can follow. This tests your ability to articulate what you've learned and translate it into teachable form.
For example: “You developed judgment on credible versus inflated synergy estimates. Write a spec that teaches an AI model to apply this critical lens to synergy assumptions. What inputs would you require and what errors would you flag?”
3.Designing realistic evaluation benchmarks
A good benchmark separates real model capability from pattern-matching. You need to design tasks complex enough to mirror actual professional work, not simplified textbook problems.
For example: “Design a benchmark for evaluating covenant analysis in leveraged loans. What covenant scenarios, financial conditions, and lender concerns test true understanding of violation risk versus rote recitation?”
4.Calibration across specialist domains
Finance is broad; standards applied in credit risk may not transfer perfectly to asset allocation or FP&A. You must work with colleagues in adjacent areas to keep your benchmarks consistent and realistic.
For example: “Colleagues in credit and corporate finance disagree on rigor standards for capital structure analysis. You flag an issue that credit specialists would accept. How do you discuss and resolve this to maintain consistency?”
5.Identifying and filling model capability gaps
QA uncovers what the model struggles with, and you need to design new training tasks to target those weaknesses. This tests your ability to diagnose root causes and prescribe targeted improvement.
For example: “After 50 treasury optimization reviews, the model consistently misses liquidity constraints and cash timing mismatches. What training specs would you write to close this gap, and how would you verify improvement?”
6.Communicating complex feedback clearly
Your written feedback must be precise and actionable for researchers who may lack finance depth. This tests whether you can be specific without assuming specialist knowledge.
For example: “Write a QA review of a model's dividend-versus-buyback analysis for an ML expert with limited finance background. What must you explain, what examples would you use, and how do you make feedback specific enough to improve training?”
A task you may get
Review three financial analyses (M&A, capital budgeting, risk assessment). Identify errors and reasoning flaws a pro would catch, then draft specs to teach the model to avoid them.
How to prepare
- Bring examples from your own work of financial analyses you rejected for quality reasons and be ready to explain the specific flaws
- Review recent AI model outputs on finance topics in published benchmarks or papers, and practice identifying reasoning gaps versus simply checking answers
- Prepare a 2-3 minute overview of your finance specialty and a complex problem you solved, including judgment calls and subtle reasoning.
- Research the specific AI lab or company culture to understand what 'cutting-edge AI' means to them and where they think finance models fall short
The facts
- Pay
- $110–150/hr
- Hours
- Full time, 40 hours a week
- Where
- Hybrid · Bay Area, CA
- Open to
- USA
- Field
- Finance
- Posted
- 8/12/2026
- Places left
- 5
We wrote this page from the public Mercor listing. It may be out of date, so read the full posting before you apply.