AI Architect – Tester
49 Solutions
full-time
Posted on:
Location Type: Hybrid
Location: Ottawa • 🇨🇦 Canada
Visit company websiteJob Level
Mid-LevelSenior
Tech Stack
JavaKerasPythonPyTorchTensorflow
About the role
- Design, develop, and execute test strategies for AI applications, including AI agents, RAG, and LLMs.
- Leverage AI tools to test applications on a regular basis.
- Evaluate and validate machine learning models, algorithms, and AI frameworks such as TensorFlow, Keras, and PyTorch.
- Implement test automation for AI systems using Python, Java, or R.
- Collaborate with cross-functional teams to identify, analyze, and resolve performance or functionality issues.
- Support DevOps processes and CI/CD pipelines in AI application deployment.
- Ensure compliance with best practices and security requirements for federal government projects.
Requirements
- Minimum 5 years of experience in software testing or test automation, specifically with AI applications.
- Strong proficiency with AI frameworks, testing tools, and AI technologies.
- Experience with AI agents, RAG, LLMs, and machine learning models.
- Strong programming skills in Python, Java, or R.
- Familiarity with DevOps processes and CI/CD pipelines.
- Excellent analytical, problem-solving, and communication skills.
- A degree in Computer Science, Engineering, or a related field.
- A valid Canadian Government Security Clearance is a non-negotiable
Benefits
- Remote/Hybrid Work
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
test strategiestest automationmachine learning modelsalgorithmsAI frameworksPythonJavaRAI applicationsperformance testing
Soft skills
analytical skillsproblem-solving skillscommunication skills
Certifications
Canadian Government Security Clearance