Machine Learning Engineer – Evaluation
HackerRank
full-time
Posted on:
Location Type: Hybrid
Location: Santa Clara • California • United States
Visit company websiteExplore more
Salary
💰 $120,000 - $235,000 per year
About the role
- Build LLM-powered evaluation pipelines for assessing AI usage skills
- Own the evaluation methodology from rubric definition to bias auditing
- Design experiments to find effective evaluation strategies
- Develop RAG pipelines and fine-tuning workflows
- Create benchmarking infrastructure for evaluation quality
Requirements
- Experience shipping LLM-powered systems in production
- Rigor in measurement of models
- Research mindset and comfort in undefined spaces
- Systems thinking across data pipelines, models, and rubrics
- Ability to communicate ML judgments in plain language
Benefits
- 10% annual bonus tied to individual and company performance
- Equity (stock options)
- Comprehensive package of cash and non-cash benefits
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
LLM-powered systemsevaluation pipelinesevaluation methodologybias auditingRAG pipelinesfine-tuning workflowsbenchmarking infrastructuremeasurement of models
Soft Skills
research mindsetsystems thinkingcommunication