Senior Engineer – GenAI Quality Assurance

Johnson & Johnson

Senior Engineer focusing on GenAI Quality Assurance at Johnson & Johnson. Responsible for validating and improving GenAI products across the product lifecycle and collaborating with cross-functional teams.

Posted 7/17/2026full-timeCornellà de Llobregat • 🇪🇸 SpainSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and implementing QA strategies for GenAI systems, with advanced skills in Python and experience in LLM-based systems. Proficient in establishing testing standards, conducting code reviews, and collaborating with cross-functional teams to ensure product quality.

Highest-signal resume keywords

Advanced Python SkillsExperience with LLM-Based SystemsFamiliarity with RAG & Graph FrameworksProven Ability to Implement Test FrameworksExperience with Version Control (Git)

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Automated QA StrategiesManual QA StrategiesRegression TestingData ValidationAPI TestingData Pipeline TestingTest Framework ImplementationDebugging PipelinesSynthetic Test Data GenerationModel Behavior Evaluation

Soft Skills

CollaborationLeadershipCommunication

Tools & Technologies

LLM APIsAWS BedrockAzure FoundryGCP

Industry Keywords

GenAI SystemsContinuous IntegrationContinuous DeploymentSystem Design Reviews

Tech Stack

Tools & technologies

AWSAzureGoogle Cloud PlatformPython

About the role

Key responsibilities & impact

Design and implement automated and manual QA strategies for GenAI systems
Build regression tests, generate synthetic test data, build test harnesses and evaluation pipelines for accuracy
Validate prompt logic, model behavior and evaluation metrics
Execute tests and debug pipelines
Support deployment of GenAI products
Lead system design reviews
Collaborate closely with data scientists and developers
Establish testing standards and workflows for continuous integration and deployment
Conduct code reviews and document system design decisions

Requirements

What you’ll need

3+ years of experience as a software engineer
Familiarity with RAG & Graph frameworks
5+ years of experience in production systems
1+ year experience in GenAI systems
Advanced Python skills
Experience with LLM-based systems
Hands-on experience with: LLM APIs, AWS Bedrock, Azure Foundry, GCP
Proven ability to implement test frameworks
Knowledge of API testing, data validation, data pipeline testing
Experience with version control (Git)

Benefits

Comp & perks

Inclusive work environment
Health is everything