Mercor

French

• Evaluate generative musical AI model outputs across different categories of music in French
• Evaluate AI model output lyrics, voice generation, and other standards
• Score the quality of musical training data
• Rate AI-generated music samples head-to-head on musicality, creativity, prompt adherence, vocal quality, and production/mix quality
• Annotate songs in detail using a structured taxonomy, including genre/sub-genre, song structure, and vocal/instrumental characteristics
• Complete a 25-minute conversational interview
• Work on projects training and enhancing AI systems

Music Audio Expert, French

Sales Engineer

• Design precise, task-specific grading criteria for real-world pre-sales and solutions-engineering deliverables
• Evaluate technical discovery plans, tailored product demonstrations, proof-of-concept and technical evaluation plans, security questionnaires and RFP responses, integration/API/architecture explanations, and product-fit and technical-risk assessments
• Score AI-generated and human work samples against defined criteria
• Provide detailed written justifications for every score
• Apply consistent, evidence-based judgment so scores are reproducible and defensible
• Incorporate structured feedback from senior reviewers and iterate quickly
• Work on projects training and enhancing AI systems

Sales Engineering Expert

Artificial Intelligence

• Red team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
• Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
• Apply taxonomies, benchmarks, and playbooks to keep testing consistent
• Produce reproducible reports, datasets, and attack cases for customers
• Probe AI systems to uncover vulnerabilities automated tests miss
• Expand evaluation coverage and reduce production surprises
• Support Mercor customers in improving the safety and robustness of their AI systems

AI Safety Experts – English, Malay

• Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
• Generate high-quality human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
• Apply taxonomies, benchmarks, and playbooks to keep testing consistent
• Produce reproducible reports, datasets, and attack cases that customers can act on
• Uncover vulnerabilities automated tests miss
• Expand evaluation coverage and reduce production surprises
• Strengthen customer AI systems and help make them more robust, safe, and trustworthy
• Work on projects training and enhancing frontier AI systems

AI Safety Expert, English, Danish

Machine Learning Engineer

• Design well-defined, multi-step machine-learning tasks from real ML research ideas
• Implement changes, run training experiments, and analyze results to establish correct solutions
• Build tasks around reinforcement-learning concepts such as reward functions and training behavior
• Evaluate frontier models and identify where and why they fall short
• Compare notes with researchers and fellow experts to maintain consistency, rigor, and fairness
• Work in a tight feedback loop with the lab’s researchers

Music Audio Expert, French

Sales Engineering Expert

AI Safety Experts – English, Malay

AI Safety Expert, English, Danish

Machine Learning Engineer – Model Evaluation, Experimentation