Research, develop, and iterate on LLM-as-a-Judge prototypes and offline LLM evaluation systems
Drive own roadmap, determining areas for rapid iteration or deeper development
Create insights to shape future member-facing investments by influencing the broader Product team
Collaborate with Data Scientists, ML Scientists, and Engineers
Stay updated with LLM advancement research and implement new best practices and methodologies
Requirements
Strong foundation in deep learning and LLMs
Proven hands-on industry experience in improving large generative models and model evaluation
Substantial relevant industry experience building scalable ML models
Experience in natural language processing and machine learning
Advanced degree (PhD) in Computer Science, Electrical Engineering, or a related technical field with a focus on machine learning, artificial intelligence, or computer vision
Flexibility with approach, able to pivot between research goals and implementing end-to-end solutions
Excellent problem-solving skills with innovative solutions
Excellent communicator capable of explaining complex technical details to both technical and non-technical audiences
Thrives in fast-paced, dynamic environments with ambiguity.
Benefits
Health Plans
Mental Health support
401(k) Retirement Plan with employer match
Stock Option Program
Disability Programs
Health Savings and Flexible Spending Accounts
Family-forming benefits
Life and Serious Injury Benefits
Paid leave of absence programs
Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off.
Full-time salaried employees are immediately entitled to flexible time off.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
deep learningLLMslarge generative modelsmodel evaluationscalable ML modelsnatural language processingmachine learningartificial intelligencecomputer vision