Applied Physics Benchmark Specialist

What you would do

• Author original, challenging multiple-choice physics questions that assess conceptual mastery rather than rote memorization in your area of expertise.
• Design questions with one unambiguously correct answer and nine subtly incorrect alternatives that represent realistic misconceptions.
• Develop detailed solutions with clear derivation steps, explaining the reasoning path and why incorrect options appear credible to expert evaluators.
• Support each question with 1-5 academic references from peer-reviewed journals, university repositories, or established physics literature.
• Review pre-written questions for conceptual accuracy, clarity of language, completeness of information, and appropriate difficulty rating.

Who they want

• Advanced degree (PhD qualification or doctoral candidacy) in Physics, Applied Physics, Astrophysics, or related specialty with strong theoretical expertise.
• Master's degree acceptable for candidates demonstrating exceptional depth and expertise within a specific physics subdomain.
• Demonstrated ability crafting rigorous physics problems, whether through olympiad writing, academic problem sets, or assessment design experience.
• Commitment of 10+ hours per week for asynchronous, fully remote work across eight physics domains including semiconductor, photonics, and plasma physics.
• Excellent written communication skills allowing clear explanation of complex mathematical and conceptual ideas for expert-level audiences.

Main skills

What the interview asks about

1. 1.Question design and distractors

   Creating plausible wrong answers requires understanding how physicists think and where conceptual errors occur; this assesses whether candidates know their domain deeply.

   For example: “You're designing a quantum optics question about photon indistinguishability. What three distinct physics misconceptions would lead an expert-level solver to choose each of your three most plausible wrong answers?”

2. 2.Conceptual versus computational testing

   Distinguishing between surface-level calculation and genuine understanding reveals whether candidates can design questions that challenge expert reasoning, not just mathematical ability.

   For example: “Your nanoelectronics question currently asks students to compute band gap energy numerically. How would you reframe it to assess whether they understand why band gaps emerge from electron-lattice coupling?”

3. 3.Solution clarity and rigor

   Writing Chain-of-Thought solutions that teach demonstrates whether candidates can communicate physics reasoning clearly; poor explanations undermine benchmark quality.

   For example: “Your plasma physics solution uses four algebraic manipulation steps between the governing equation and final result. At what point would you add an intermediate physical interpretation step to clarify the derivation logic?”

4. 4.Problem statement completeness

   Self-contained problem statements prevent questions from testing reading comprehension or information hunting rather than physics knowledge; this is critical for benchmark reliability.

   For example: “Your geophysics question assumes knowledge of pore pressure effects on seismic velocity, but doesn't define pore pressure in the problem statement. What specific physical context would you add to make the problem self-contained?”

5. 5.Difficulty rating accuracy

   Correctly assessing whether a question is Medium, Hard, or Expert requires understanding cognitive load; miscalibration undermines benchmark validity and AI evaluation.

   For example: “You rated a question as Hard because it requires differentiation and substitution, but the physics concepts are introductory. How would you reconsider the difficulty rating to match your target audience?”

A task you may get

Authoring a complete physics question with 10 answer choices, detailed solution, three references, and a written justification for the difficulty rating in your primary domain.

How to prepare

• Select 2-3 recent physics publications or textbook sections in your subdomain and identify the deep conceptual ideas that distinguish expert-level understanding.
• Document 3-4 physics misconceptions or common errors you've observed in teaching or research contexts that you could use in distractor design.
• Review existing physics competitions, olympiads, or graduate-level assessments to understand how rigorous questions test conceptual understanding.
• Prepare examples of your academic writing, including published papers, problem sets you've authored, or peer-reviewed question sets.

The facts

Pay

$61–77/hr

Hours

Hourly

Where

Remote

Field

Life, Physical, and Social Science

Posted

8/13/2026

Places left

8

We wrote this page from the public Mercor listing. It may be out of date, so read the full posting before you apply.