Bilingual Evaluator - Fully Remote | Upto $50/hr

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Dutch Audio Generalist Evaluator Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Duration: 3–6 months

Role Responsibilities

• Transcribe audio and video with precision in Dutch and English. Ensure adherence to multiple constraints and instructions.
• Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English.
• Conduct model testing by running prompts and assessing outputs against expectations.
• Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.
• Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.

Qualifications

Must-Have

• Strong writing and critical thinking skills
• Ability to work independently and meet deadlines
• Fluent in Dutch and English
• Able to work within GMT or PST working hours

Preferred

• College students or graduates

Application Process (Takes 20–30 mins to complete)

• Complete an AI-led interview (approximately 15 minutes)
• If selected, you will be invited to work on the project

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.