
QA Analyst – ML/AI
Alithya
full-time
Posted on:
Location Type: Office
Location: Montreal • Canada
Visit company websiteExplore more
About the role
- Test ML workflows and their integrations
- Test models (functional validation, bias, drift)
- Validate MLOps pipelines: training, deployment, and monitoring
- Verify AI environment configurations (compute, security)
- Produce specialized test plans for models and LLMs.
Requirements
- Experience in quality assurance (QA) in a data science/ML context
- Strong understanding of ML models and LLMs
- Comfortable with Azure ML and AI-focused DevOps
- Able to validate ML performance, drift, and risks
- French: Advanced
- English: Intermediate
- Please note that intermediate English is required due to the nature of the tasks, including frequent communication with employees and managers outside Quebec.
Benefits
- Work-life balance helps us stay at our best. We offer flexible work options, and with our Unlimited Vacation Plan, you can rest and recharge when you need it most.
- Your contributions matter. From day one, our total rewards package offers a comprehensive compensation plan, including short-term incentive programs.
- Our benefits are designed with optimal health and wellness in mind. You’ll have access to 24/7 virtual healthcare, as well as an extensive wellness portal that provides tools and resources to support your physical, mental, emotional, and financial well-being.
- Continuous growth and learning. When you join Alithya, you’re joining a team committed to investing in your development. Refining your expertise is essential in a rapidly evolving industry, and we support your continuous growth every step of the way. Through partnerships with world-renowned education leaders, we provide access to thousands of top-rated online courses and certifications. With exclusive leadership programs designed to empower you to lead your teams with confidence and deliver impactful outcomes, and with a tuition reimbursement program for external training, we set you up for success to thrive and achieve your ambitions.
- Our people drive our success. Through our Employee Share Purchase Plan with matched contributions, you become a stakeholder, sharing in our growth and directly benefiting from our collective achievements.
- The diversity of our backgrounds, experiences, thoughts and insights is our competitive advantage. We foster a collaborative environment rooted in our core values of respect, well-being, passion, trust, integrity, and creativity.
- Fostering an environment where you can thrive starts with ensuring an accessible recruitment process. If you require any accommodations, we welcome you to contact us.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
quality assuranceML workflowsfunctional validationbias testingdrift testingMLOps pipelinesmodel validationtest plansAI environment configurationsML performance validation
Soft Skills
communicationinterpersonal skills