Senior Machine Learning Test Engineer

Autodesk

Senior Machine Learning Test Engineer ensuring quality of machine learning systems at Autodesk. Collaborating across research and product to uphold quality standards for ML models.

Posted 5/15/2026full-timeMassachusetts, New Hampshire, New Jersey, Virginia, West Virginia • 🇺🇸 United StatesSeniorWebsite

Tech Stack

Tools & technologies

JenkinsPython

About the role

Key responsibilities & impact

Define ML quality strategy and acceptance criteria across data, model, and system levels
Design and maintain model evaluation suites, metrics, and test datasets
Evaluating CAD RL model outputs for geometric validity or policy stability
Defining structured rubrics that translate qualitative findings into measurable evaluation gates
Testing ML Models from product side API Testing
Automate ML QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins)
Create and maintain test harnesses for ML services and APIs
Mentor teams on ML QA best practices and consistent evaluation standards
Build quality gates for training and deployment pipelines (e.g., regression checks, drift detection)
Contribute to multi-team projects and codebases, ensuring code quality and consistency
Participate in code reviews and provide constructive feedback to peers
Document and present findings and ideas across the company

Requirements

What you’ll need

Bachelor’s degree in Computer Science, Engineering, or equivalent experience
7+ years of professional experience in software engineering or QA for ML/AI systems
Strong programming skills in Python, with experience in test automation
Familiarity with popular CAD environments tooling
Proficient in Automation and UAT test suite/framework
Experience designing QA frameworks or platforms used by multiple teams
Excellent problem-solving skills and attention to detail
Strong communication and collaboration skills
Understanding of software architecture and design patterns
Ability to work in an agile development environment

Benefits

Comp & perks

Health insurance
Professional development opportunities

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonML quality strategymodel evaluationtest automationCAD RL model evaluationAPI TestingCI/CDQA frameworksregression checksdrift detection

Soft Skills

problem-solvingattention to detailcommunicationcollaborationmentoringconstructive feedbackdocumentationpresentation skills

Certifications

Bachelor’s degree in Computer ScienceBachelor’s degree in Engineering