Alithya

QA Analyst – ML/AI

Alithya

full-time

Posted on:

Location Type: Office

Location: MontrealCanada

Visit company website

Explore more

AI Apply
Apply

Tech Stack

About the role

  • Test ML workflows and their integrations
  • Test models (functional validation, bias, drift)
  • Validate MLOps pipelines: training, deployment, and monitoring
  • Verify AI environment configurations (compute, security)
  • Produce specialized test plans for models and LLMs.

Requirements

  • Experience in quality assurance (QA) in a data science/ML context
  • Strong understanding of ML models and LLMs
  • Comfortable with Azure ML and AI-focused DevOps
  • Able to validate ML performance, drift, and risks
  • French: Advanced
  • English: Intermediate
  • Please note that intermediate English is required due to the nature of the tasks, including frequent communication with employees and managers outside Quebec.
Benefits
  • Work-life balance helps us stay at our best. We offer flexible work options, and with our Unlimited Vacation Plan, you can rest and recharge when you need it most.
  • Your contributions matter. From day one, our total rewards package offers a comprehensive compensation plan, including short-term incentive programs.
  • Our benefits are designed with optimal health and wellness in mind. You’ll have access to 24/7 virtual healthcare, as well as an extensive wellness portal that provides tools and resources to support your physical, mental, emotional, and financial well-being.
  • Continuous growth and learning. When you join Alithya, you’re joining a team committed to investing in your development. Refining your expertise is essential in a rapidly evolving industry, and we support your continuous growth every step of the way. Through partnerships with world-renowned education leaders, we provide access to thousands of top-rated online courses and certifications. With exclusive leadership programs designed to empower you to lead your teams with confidence and deliver impactful outcomes, and with a tuition reimbursement program for external training, we set you up for success to thrive and achieve your ambitions.
  • Our people drive our success. Through our Employee Share Purchase Plan with matched contributions, you become a stakeholder, sharing in our growth and directly benefiting from our collective achievements.
  • The diversity of our backgrounds, experiences, thoughts and insights is our competitive advantage. We foster a collaborative environment rooted in our core values of respect, well-being, passion, trust, integrity, and creativity.
  • Fostering an environment where you can thrive starts with ensuring an accessible recruitment process. If you require any accommodations, we welcome you to contact us.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
quality assuranceML workflowsfunctional validationbias testingdrift testingMLOps pipelinesmodel validationtest plansAI environment configurationsML performance validation
Soft Skills
communicationinterpersonal skills