FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in leading test activities and implementing comprehensive automation strategies for AI-driven products, ensuring product quality through effective test planning, execution, and reporting. Proficient in developing reusable automation frameworks and managing cross-functional teams to drive collaboration and quality metrics.
Highest-signal resume keywords
Automation TestingSelenium with Java/PythonCI/CD IntegrationQuality Management TechniquesAgile Methodology
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Test PlanningTest ExecutionAutomation Framework DevelopmentAI Testing StrategiesDefect TriageMetrics IdentificationRisk-Based TestingPerformance StrategyAd-Hoc ReportingBias and Fairness Testing
Soft Skills
LeadershipCollaborationMentoringCommunication
Tools & Technologies
Azure DevOpsCI/CD PipelinesAI-Assisted Test GenerationDeepEvalMulti-Agent Systems
Industry Keywords
Quality AssuranceSoftware TestingAutomation TestingAI-Driven ProductsEngineering
Tech Stack
Tools & technologiesAzureJavaPythonSelenium
About the role
Key responsibilities & impact- Lead the test activities to ensure product quality, setting project timelines and supervising the activities of other testers.
- Drive the identification of the test scope and test environment set-up, prepare test plans, identify relevant metrics and keep track of required effort.
- Manage the execution of tests, review reports and interpret recommendations for product or design changes.
- Define and implement comprehensive test strategies, standards, and risk-based coverage.
- Define and implement automation strategies across functional and AI testing domains, ensuring scalability and maintainability.
- Evaluate and adopt cutting-edge automation tools and technologies, including AI-assisted test generation and validation.
- Drive automation coverage goals, balancing risk-based testing with efficiency improvements to reduce manual effort.
- Architect and maintain reusable automation frameworks for both traditional and AI-driven applications, integrated with CI/CD pipelines.
- Design, develop, and maintain standard and ad-hoc reports tailored to business needs.
- Implement automated reporting processes to reduce manual effort and improve timeliness.
- Drive defect triage, prioritization, and release readiness decisions.
- Develop relationships with other engineering groups to evaluate, recommend and implement testing procedures for products, systems, components or modifications.
- Implement AI testing strategies including DeepEval for model evaluation, ensuring robustness and reliability of outputs.
- Design and execute test plans for RAG (Retrieval-Augmented Generation) frameworks , validating retrieval and generation accuracy.
- Develop agentic validation workflows for multi-agent systems, focusing on reasoning accuracy and orchestration.
- Conduct bias, fairness, and ethical compliance testing for AI models.
- Build reusable automation frameworks for AI testing integrated with CI/CD pipelines.
- Lead and mentor a cross-functional testing team , fostering collaboration across AI, data engineering, and product development groups.
- Define strategic testing roadmaps for AI-driven products and manage stakeholder communication on quality metrics and risks.
Requirements
What you’ll need- Bachelor's degree in Computer Science, Engineering, IT, or related field and 12+ years of relevant work experience.
- Specialized knowledge of Quality Management techniques.
- Proficiency in testing concepts/standards & Agile methodology.
- Good understanding of Automation Testing concepts and ability to implement automation/performance strategy.
- Hands-on experience authoring, building and adopting large-scale automation frameworks across UI, functional, API and back-end integration.
- Experience in Selenium with Java / Python - scripting/coding level.
- Experience and knowledge of Azure DevOps or any relevant defect management tool and CI/CD.
Benefits
Comp & perks- Competitive salary
- Health insurance
- Flexible working arrangements
- Professional development opportunities
