McDermott Will & Emery

AI Solutions Quality Assurance Analyst

McDermott Will & Emery

full-time

Posted on:

Location Type: Hybrid

Location: ChicagoFloridaIllinoisUnited States

Visit company website

Explore more

AI Apply
Apply

Salary

💰 $93,000 - $142,000 per year

Tech Stack

About the role

  • Own the full QA lifecycle for AI-powered solutions — from unit and integration testing through system, performance, and scalability testing
  • Partner with Analysts to generate and evaluate test cases using AI-assisted tools, with particular focus on boundary conditions, edge cases, and AI output validation
  • Work with the engineering team to define and integrate automated test suites into the Azure DevOps CI/CD pipeline for each solution
  • Define system-level test strategies in collaboration with the Director of QA, covering functional, regression, and non-functional testing requirements
  • Coordinate with the dedicated security team to translate security testing guidance into solution-specific security test cases
  • Evaluate AI solution reliability across varied inputs — ensuring consistent, predictable behavior under real-world conditions
  • Maintain test documentation, defect tracking, and quality metrics that give leadership clear visibility into solution readiness
  • Champion a quality culture across the delivery team — making testing a natural part of the development workflow, not a gate at the end

Requirements

  • 4+ years of formal QA experience, including writing and executing test scripts across the full testing lifecycle
  • Strong experience with unit, integration, system, and regression testing — both manual and automated
  • Hands-on experience integrating test suites into CI/CD pipelines; Azure DevOps experience strongly preferred
  • Demonstrated ability to design boundary and edge case tests for complex, data-driven applications
  • AI fluency — you use AI tools actively and can direct leading AI platforms to generate, evaluate, and refine test cases
  • Understanding of performance and scalability testing concepts; experience with load testing tools a plus
  • Solid grasp of defect tracking, test documentation, and quality metrics reporting
  • Strong analytical thinking — you approach untested AI behavior the way an engineer approaches an unknown system
  • BS in Computer Science, Information Systems, Engineering, or equivalent experience
  • Preferred: Experience testing AI-powered applications — prompt-driven systems, agentic workflows, or LLM-integrated tools
  • Familiarity with AI-assisted test generation workflows and code-generating platforms
  • Exposure to security testing principles in collaboration with a dedicated security team
  • Experience in legal, financial services, or other regulated industry environments
  • Knowledge of Azure DevOps , including pipeline configuration and automated test integration.
Benefits
  • Wellness is integral to building a successful career and a rich life.
  • Generous compensation packages that recognize hard work and excellence.
  • Full time positions are eligible for a discretionary bonus and a comprehensive benefits package.
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
QA lifecycleunit testingintegration testingsystem testingperformance testingscalability testingautomated testingtest script writingdefect trackingquality metrics
Soft Skills
analytical thinkingcollaborationquality culture advocacy
Certifications
BS in Computer ScienceBS in Information SystemsBS in Engineering