$18/hr · Mercor · Hourly, 20 hours a week
A Thai music specialist who evaluates AI-generated lyrics for quality, originality, and cultural authenticity.
What you would do
- Compare AI-generated lyrics against published songs to identify similarities and assess originality
- Rate lyrics across dimensions like quality, creativity, prompt adherence, and naturalness
- Evaluate whether Thai word choice, slang, and regional expressions sound authentic
- Provide feedback on AI music model performance using detailed quality standards
Who they want
- Native or near-native Thai proficiency with fluent English communication skills
- Professional background as songwriter, lyricist, performer, composer, or music journalist
- Knowledge of contemporary Thai music genres, sub-genres, and current artists
- Experience with critical music listening using headphones or studio monitors
- Flexible availability, typically 20 hours per week across 6 months
Main skills
What the interview asks about
1.Lyric authenticity evaluation
The interviewer needs to verify you can judge whether generated Thai lyrics sound natural and appropriate to cultural context, which directly impacts the quality of your ratings.
For example: “Show me a Thai rap verse an AI generated about urban life, using slang and colloquialisms. How would you evaluate whether the language choices feel authentic to real Bangkok rap?”
2.Identifying lyric similarities
Detecting when AI output closely mirrors existing published work requires both musical knowledge and careful comparative analysis, core to your evaluation duties.
For example: “The AI generated a love song with lines like 'you are my heart, my soul, my everything.' You recall hearing something similar in a well-known Thai pop ballad from 2015. Walk through how you'd document this similarity.”
3.Genre and style assessment
Rating whether lyrics fit their intended genre requires familiarity with Thai music traditions and contemporary trends, which shapes your credibility as an evaluator.
For example: “You're rating lyrics labeled as 'Thai folk-inspired' but they use modern slang and Western imagery. What's your assessment of how well they align with folk traditions?”
4.Multi-dimension quality judgment
Effectively rating creativity, prompt adherence, and quality simultaneously requires structured thinking and clear criteria, essential for consistent feedback.
For example: “The prompt requested a love song but the AI produced lyrics about friendship. The lyrics are well-written technically. How would you rate this in terms of prompt adherence vs. overall quality?”
A task you may get
Compare three AI-generated Thai song lyrics against published Thai songs, rating each on originality, naturalness, genre alignment, and prompt adherence using provided quality standards.
How to prepare
- Review Thai music genres and contemporary artists to build working knowledge
- Listen critically to Thai music across different styles and identify what makes lyrics authentic
- Prepare examples of how different regional Thai dialects and slang are used in songs
- Practice evaluating lyrics on multiple dimensions: creativity, technical quality, cultural fit
The facts
- Pay
- $18/hr
- Hours
- Hourly, 20 hours a week
- Where
- Remote
- Field
- Arts & Design
- Posted
- 8/12/2026
- Places left
- 1
We wrote this page from the public Mercor listing. It may be out of date, so read the full posting before you apply.