Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
JobTailor Logo

See all jobs on JobTailor

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
VetsEZ

Senior DevOps Automation Engineer

VetsEZ

Senior DevOps automation engineer testing AI-powered patient summarization for VetsEZ’s federal healthcare modernization project. Automating C-CDA, CDS, API, and AI quality validation.

Posted 8/21/2026full-timeRemote • 🇺🇸 United StatesSeniorWebsite

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in testing healthcare software applications, particularly in validating AI-generated outputs and ensuring compliance with C-CDA standards. Proficient in developing automated testing solutions and collaborating with cross-functional teams to enhance clinical workflows.

Highest-signal resume keywords
C-CDA StandardsAI-Generated Output ValidationTest Automation FrameworksHealthcare Interoperability StandardsClinical Decision Support Testing

ATS Keywords

Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
Test Plan DevelopmentXML Document ValidationAutomated Testing SolutionsRegression TestingDefect AnalysisAcceptance Criteria CreationBoundary TestingEdge-Case TestingPerformance TestingUsability Testing
Soft Skills
Analytical SkillsProblem-Solving SkillsCommunication Skills
Tools & Technologies
AI-Assisted Testing ToolsAPI Testing ToolsDefect Management PlatformsSMART on FHIRCDS Hooks
Industry Keywords
Healthcare Software TestingClinical Data StandardsAgile DevelopmentDevSecOpsFederal Healthcare Modernization

Tech Stack

Tools & technologies
CloudCyber Security

About the role

Key responsibilities & impact
  • Develop comprehensive test plans, test cases, and acceptance criteria for AI-powered patient summarization capabilities
  • Create traceability between business requirements, clinical data standards, and test scenarios
  • Design test coverage across clinical document types including CCDs, Discharge Summaries, Progress Notes, and History & Physical documents
  • Develop positive, negative, boundary, and edge-case testing scenarios for AI-enabled clinical applications
  • Analyze and validate C-CDA XML documents, including headers, sections, templates, and clinical entries
  • Verify extraction and summarization of medications, allergies, laboratory results, procedures, care plans, and diagnoses
  • Ensure AI-generated summaries reflect source clinical documentation and maintain traceability to original sources
  • Perform functional, integration, system, regression, performance, and user acceptance testing
  • Develop and maintain automated test suites for document ingestion, AI summarization, APIs, and user interfaces
  • Test CDS workflows and patient-context-driven launch scenarios across multiple data sources and patient encounters
  • Support CI/CD pipelines through automated quality gates and continuous testing
  • Build automated validation frameworks for AI-generated summaries
  • Evaluate AI-generated content for clinical completeness, consistency, usability, accuracy, and reliability
  • Identify omissions, inaccuracies, hallucinations, and other AI-generated defects affecting clinical workflows
  • Validate AI guardrails, monitoring capabilities, auditability, and quality controls
  • Participate in defect triage, root-cause analysis, and release-readiness activities
  • Create test documentation, defect reports, traceability matrices, and quality assessments
  • Collaborate with software engineers, solution architects, clinicians, product owners, cybersecurity teams, and government stakeholders
  • Leverage AI-assisted tools to accelerate testing, automation, regression testing, defect analysis, and quality assurance
  • Take on additional tasks as needed to support team objectives and project success

Requirements

What you’ll need
  • Bachelor’s degree in Computer Science, Information Technology, Health Informatics, Engineering, or a related technical discipline, or equivalent experience
  • Minimum of 5 years of experience testing healthcare software applications
  • Strong knowledge of Consolidated Clinical Document Architecture (C-CDA) standards, including clinical document structure, sections, templates, and entries
  • Hands-on experience reading, validating, and troubleshooting XML-based healthcare data
  • Experience with healthcare interoperability standards and clinical data exchange
  • Experience testing Clinical Decision Support (CDS) applications and workflows
  • Familiarity with SMART on FHIR, CDS Hooks, REST APIs, and related interoperability technologies
  • Experience with test automation frameworks, API testing tools, and defect management platforms
  • Experience developing and maintaining automated testing solutions within Agile and DevSecOps environments
  • Experience with AI-assisted testing tools and techniques for test case generation, automation development, regression testing, defect analysis, and quality assurance
  • Familiarity with Generative AI and Large Language Models (LLMs), including using AI to create and maintain automated test scripts, validation frameworks, and test data
  • Experience validating AI-generated outputs and establishing quality controls for accuracy, consistency, repeatability, and reliability
  • Strong analytical, troubleshooting, and problem-solving skills
  • Excellent written and verbal communication skills
  • Additional qualifications include VA healthcare systems experience, USCDI knowledge, healthcare terminology knowledge, AI/ML healthcare solution validation, AI-powered testing platforms, autonomous or semi-autonomous AI testing workflows, prompt engineering, accessibility and usability testing, Agile/DevSecOps/cloud-native environments, and federal healthcare modernization exposure
  • U.S. Citizenship is required
  • Must successfully complete a background check
  • Ability to obtain and maintain a Government/Public Trust clearance, including required fingerprinting, when required
  • Sponsorship is not offered

Benefits

Comp & perks
  • Medical/Dental/Vision
  • 401k with Employer Match
  • PTO + Federal Holidays
  • Corporate Laptop
  • Training Opportunities
  • Remote Opportunity