QE Lead – AI & Analytics
RIB Software
full-time
Posted on:
Location Type: Office
Location: Pune • India
Visit company websiteExplore more
Job Level
Tech Stack
About the role
- Own and define the QA strategy for AI and Analytics solutions, including ML models, RAG pipelines, and data-driven systems.
- Design and execute testing approaches for AI systems, covering functional, non-functional, bias, robustness, and reliability aspects.
- Establish observability, evaluation, and monitoring practices for AI quality in pre-production and production environments.
- Lead and contribute to test automation frameworks for AI, APIs, data pipelines, and analytics workflows.
- Collaborate with cross-functional teams to embed quality early in the AI development lifecycle.
Requirements
- Proven experience in quality engineering with exposure to AI/ML-based applications and analytics platforms.
- Hands-on experience testing AI systems such as RAG, LLM-based applications, or predictive models.
- Strong understanding of manual and automated testing approaches for APIs, data pipelines, and distributed systems.
- Experience with AI evaluation techniques, metrics, and validation strategies (accuracy, relevance, drift, hallucination, etc.).
- Ability to define QA standards, mentor engineers, and influence quality practices across teams.
Benefits
- RIB may require all successful applicants to undergo and pass a comprehensive background check before they start employment.
- Background checks will be conducted in accordance with local laws and may, subject to those laws, include proof of educational attainment, employment history verification, proof of work authorization, criminal records, identity verification, credit check. Certain positions dealing with sensitive and/or third party personal data may involve additional background check criteria.
- RIB is an Equal Opportunity Employer. We are committed to being an exemplary employer with an inclusive culture, developing a workplace environment where all our employees are treated with dignity and respect. We value diversity and the expertise that people from different backgrounds bring to our business.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
QA strategytest automation frameworksfunctional testingnon-functional testingbias testingrobustness testingreliability testingAI evaluation techniquesmetricsvalidation strategies
Soft Skills
mentoringinfluencing quality practicescollaboration