
Lead QA Engineer, Artificial Intelligence
Global Payments Inc.
full-time
Posted on:
Location Type: Remote
Location: Oklahoma • Texas • United States
Visit company websiteExplore more
Job Level
About the role
- Develop and implement QA strategies tailored for AI/ML solutions, including models, APIs, pipelines, and agent-based architectures.
- Create and maintain automated and manual test cases for model validation (accuracy, bias, robustness, explainability, drift).
- Collaborate with AI engineers, data scientists, and product teams to define success criteria, acceptance standards, and performance metrics.
- Validate model outputs and system behaviors against business and ethical guidelines.
- Perform regression, integration, stress, and adversarial testing of AI models and systems.
- Identify, log, and track bugs and anomalies, ensuring timely resolutions.
- Support monitoring production AI systems to detect model performance degradation (concept drift, data drift, hallucinations).
- Ensure compliance with internal AI governance standards, responsible AI principles, and regulatory requirements.
- Contribute to building automated AI testing frameworks, pipelines, and synthetic data generation systems.
- Document testing procedures, results, and quality assessments clearly and effectively.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Minimum 6 years of experience in quality assurance, specifically testing AI/ML applications.
- Hands-on skills with Python and relevant AI/QA libraries (Pytest, Unittest, Great Expectations, MLflow, Deepchecks, etc.).
- Familiarity with machine learning frameworks (TensorFlow, PyTorch, or scikit-learn).
- Experience with test automation tools and frameworks.
- Knowledge of CI/CD tools (Jenkins, GitLab CI, or similar).
- Experience with containerization technologies like Docker and orchestration systems like Kubernetes.
- Familiarity with version control systems like Git.
- Strong understanding of software testing methodologies and best practices.
- Excellent analytical and problem-solving skills.
- Excellent communication and collaboration skills.
Benefits
- Health insurance
- Retirement plans
- Paid time off
- Flexible work arrangements
- Professional development
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Pythonautomated testingmanual testingmodel validationregression testingintegration testingstress testingadversarial testingAI/ML applicationssoftware testing methodologies
Soft Skills
analytical skillsproblem-solving skillscommunication skillscollaboration skills
Certifications
Bachelor’s degree in Computer ScienceBachelor’s degree in Engineering