Training Turk

Commercial Insurance Broker & Risk Advisor

$80/hr · Mercor · Hourly, 20 hours a week

Create and evaluate insurance advisory scenarios to train AI on commercial risk advice.

What you would do

  • Design client exposure and coverage scenarios
  • Draft detailed proposal and renewal analyses
  • Write benchmark “golden” responses
  • Score AI outputs against accuracy and suitability rubrics
  • Provide corrective feedback to the research team

Who they want

  • 2+ years in commercial insurance brokerage or risk advisory
  • Experience with small, middle‑market, or large accounts
  • Familiarity with submissions, binders, policy comparisons, and renewals
  • Strong written communication and attention to detail
  • Available 20‑40+ hours weekly

Main skills

Commercial insurance expertiseRisk advisoryScenario creation

What the interview asks about

  1. 1.Scenario construction

    The interview will verify you can recreate authentic client contexts that test an AI’s reasoning about exposures and coverage options.

    For example: “Describe how you would build a scenario for a mid‑market manufacturing client needing coverage for equipment breakdown and business interruption, including key exposure data you’d include.”

  2. 2.Coverage analysis

    Assessing your ability to produce thorough comparison documents shows you understand nuanced policy differences critical for AI training data.

    For example: “Explain the steps you’d take to compare three carriers’ cyber liability policies for a tech startup, highlighting how you’d identify gaps and recommend mitigations.”

  3. 3.Rubric grading

    Your skill in applying structured criteria to AI answers determines the quality of feedback loop for model improvement.

    For example: “Given an AI‑generated recommendation that omits deductible considerations for a large deductible property policy, illustrate how you’d score it on completeness and client suitability.”

  4. 4.Feedback articulation

    Clear, actionable feedback is essential for guiding researchers to refine model behavior.

    For example: “Provide an example of written feedback you’d give after spotting an AI suggestion that confuses broker advisory duties with carrier underwriting limits.”

A task you may get

You’ll be asked to draft a concise coverage recommendation for a hypothetical client and then grade a sample AI response against a provided rubric.

How to prepare

  • Review commercial insurance policy structures and common coverage gaps
  • Practice writing short, precise advisory memos with clear recommendations
  • Familiarize yourself with rubric‑based evaluation methods and sample AI outputs
  • Refresh knowledge of broker vs. carrier responsibilities and typical client communication flows

The facts

Pay
$80/hr
Hours
Hourly, 20 hours a week
Where
Remote · Remote United States, Canada, or United Kingdom
Open to
USA, CAN, GBR, AUS, NZL, IRL, MLT, NLD, SWE, DNK, NOR, FIN, DEU, AUT, BEL
Field
Finance
Posted
8/25/2026
Places left
1

We wrote this page from the public Mercor listing. It may be out of date, so read the full posting before you apply.