$70–150/hr · Mercor · Part time
Full-stack engineer on contract evaluating and training AI models through realistic software engineering tasks and expert feedback.
What you would do
- Assess AI-generated code for correctness, scalability, and adherence to engineering best practices
- Develop and validate rubrics that measure AI architectural reasoning and implementation quality
- Design realistic full-stack engineering scenarios reflecting actual system constraints and trade-offs
- Provide detailed technical feedback on AI suggestions for API design, database schema, and frontend architecture
- Create evaluation tasks testing AI understanding of distributed systems, performance, and reliability patterns
Who they want
- Professional experience in frontend development with React, Angular, or Vue
- Hands-on backend development with Node.js, Django, Spring, or similar frameworks
- Strong knowledge of relational and NoSQL database design and optimization
- Excellent communication skills for remote, asynchronous work and technical explanation
- Availability for part-time contract work, typically 15-30 hours per week, flexible scheduling
Main skills
What the interview asks about
1.Frontend state management and performance
Complex UI state directly affects user experience; AI must learn when to use local state, props, or centralized stores, and how choices impact rendering performance.
For example: “You're building a real-time dashboard with frequent API updates. Explain your approach to state management in React - would you use Redux, Context, or local state, and why?”
2.Backend API design and scalability
Backend choices compound across thousands of requests; AI needs to reason about rate-limiting, caching, load-balancing, and when microservices are worth the complexity.
For example: “A Node.js API currently handles 100 requests per second but traffic is doubling monthly. Walk through how you'd assess bottlenecks and decide whether to add caching, optimize queries, or redesign endpoints.”
3.Database schema for real-world constraints
Schema design determines performance, maintainability, and cost; AI must learn when normalization helps and when it hurts, and when to denormalize or shard.
For example: “You're designing schema for a comment system on a high-traffic platform. Would you use SQL with complex joins or NoSQL with denormalization? Justify your trade-offs.”
4.Evaluating AI architectural reasoning
AI sometimes suggests elegant solutions that fail under real constraints; you catch misaligned assumptions and logical errors.
For example: “AI proposes a distributed cache layer to speed up queries. Ask it to explain cache invalidation strategy, staleness tolerance, and failure modes. What weaknesses would you probe?”
5.Engineering decisions under uncertainty
Most projects have incomplete requirements and competing priorities; AI must learn how engineers reason about incomplete information and make pragmatic choices.
For example: “You're deciding between a proven but slower technology and an emerging fast framework for a new project. What factors would influence your choice, and how would you communicate that decision?”
A task you may get
Design a full-stack system for a real-time collaborative document editor. Create a technical specification covering frontend architecture, backend API design, database schema, and at least two potential bottleneck scenarios with mitigation strategies.
How to prepare
- Document a recent full-stack project you built: architecture decisions, technology choices, trade-offs, and lessons learned
- Prepare 2-3 scenarios where you evaluated or solved a backend scaling, database, or frontend performance problem
- Review current trends in your tech stack (React ecosystem, backend frameworks, database innovations) and have opinions ready
- Write brief technical explanations of key concepts: REST vs. GraphQL, SQL indexing strategies, React rendering optimization
The facts
- Pay
- $70–150/hr
- Hours
- Part time
- Where
- Remote
- Field
- Software Engineering
- Role type
- Talent network
- Posted
- 2/20/2026
We wrote this page from the public Mercor listing. It may be out of date, so read the full posting before you apply.