Autodesk

Senior Machine Learning QA Engineer

Autodesk

full-time

Posted on:

Location Type: Hybrid

Location: Toronto • Canada

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

JenkinsPython

About the role

  • Define ML quality strategy and acceptance criteria across data, model, and system levels
  • Design and maintain model evaluation suites, metrics, and test datasets
  • Evaluating CAD RL model outputs for geometric validity or policy stability
  • Defining structured rubrics that translate qualitative findings into measurable evaluation gates
  • Testing ML Models from product side API Testing
  • Automate ML QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins)
  • Create and maintain test harnesses for ML services and APIs
  • Mentor teams on ML QA best practices and consistent evaluation standards
  • Build quality gates for training and deployment pipelines (e.g., regression checks, drift detection)
  • Contribute to multi-team projects and codebases, ensuring code quality and consistency
  • Participate in code reviews and provide constructive feedback to peers
  • Document and present findings and ideas across the company

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or equivalent experience
  • 7+ years of professional experience in software engineering or QA for ML/AI systems
  • Strong programming skills in Python, with experience in test automation
  • Familiarity with popular CAD environments tooling
  • Proficient in Automation and UAT test suite/framework
  • Experience designing QA frameworks or platforms used by multiple teams
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration skills
  • Understanding of software architecture and design patterns
  • Ability to work in an agile development environment
Benefits
  • Health insurance
  • 401(k) matching
  • Flexible work hours
  • Paid time off
  • Remote work options
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
PythonML quality strategymodel evaluationtest automationCAD RL model evaluationAPI TestingCI/CDQA frameworksregression checksdrift detection
Soft Skills
problem-solvingattention to detailcommunicationcollaborationmentoringconstructive feedbackdocumentationpresentation
Certifications
Bachelor’s degree in Computer ScienceBachelor’s degree in Engineering