Skyward

QA Automation Engineer

• Be part of a team supporting the development of an AI/ML platform that will leverage generative AI to relieve user burden across the Centers for Medicare and Medicaid Services (CMS)
• Design and maintain robust, scalable automated test frameworks for web apps, APIs, and AI-driven features
• Develop automated pipelines for model validation, bias detection, and drift monitoring in ML-based systems
• Define and execute test plans that include functional, regression, performance, and AI-specific testing strategies
• Partner with AI/ML engineers to create test datasets and simulate real-world user behavior and edge cases
• Implement CI/CD-integrated quality gates to ensure AI releases meet defined reliability and fairness metrics
• Mentor junior engineers and help establish best practices in intelligent automation and AI testing
• Advocate for ethical AI standards and contribute to cross-functional discussions about responsible AI

Automation Engineer

DevOps Engineer

• Be part of a team supporting the development of an AI/ML platform that will leverage generative AI to relieve user burden across the Centers for Medicare and Medicaid Services (CMS)
• Create and maintain an enterprise application configuration management process and plan and ensure all deployments follow the same strategy
• Develop and maintain software configuration plans to support configuration identification, control, reporting, and delivery of both on prem and cloud based developed software
• Build automated deployment pipelines, define quality gates and thresholds, monitor customer feedback, track results of test automation suites, and collaborate with delivery teams
• Provide continuous support of AWS VPC infrastructures and EC2 management and implementation strategies and mentor the delivery team on best practices
• Partner with senior DevOps Engineers and delivery team in leading technical efforts on cloud infrastructure support, the DevOps approach, code quality analysis, and CI/CD implementation