Senior QA Automation Engineer, Python, Selenium, Pytest

3Pillar Global

3Pillar is an AI transformation partner seeking a Senior QA Automation Engineer. Responsibilities include testing architecture and semantic validation for AI-powered systems.

Posted 7/2/2026full-timeRemote • 🇨🇷 Costa RicaSeniorWebsite

Tech Stack

Tools & technologies

GoJavaPythonSeleniumSQL

About the role

Key responsibilities & impact

Design comprehensive test architecture – plan unit, integration, E2E, and semantic validation test suites that cover the full pipeline from profile intake through roadmap generation; define coverage targets and acceptance criteria
Build semantic validation harnesses for AI outputs – design golden-set test cases (5–8 CISO-approved reference profiles) that measure AI stage precision/recall, rigor-tier correctness, floor-control invariants, traceability completeness, and run-to-run stability; a semantic regression blocks merge
Implement access-control testing – design automated probes at API and database layers that verify cross-tenant isolation; simulate compromised sessions and verify RLS policies enforce tenant boundaries
Design and maintain CI/CD quality gates – build automated test runners that execute on every commit: unit tests, integration tests, schema validation, migration guards, image scanning, access-control probes; red builds block merge
Lead test automation practices – expand automation frameworks and practices; identify opportunities for improving test processes; recommend tools and technologies for testing efficiency
Collaborate across the team – serve as the QA voice in technical design reviews; flag testability issues early; work with the AI/LLM Lead to define what "correct" means for each pipeline stage
Mentor junior test engineers – guide the team on test design, semantic validation, and CI/CD best practices; share knowledge on testing AI systems where reproducibility is critical
Own test documentation and reporting – maintain clear test plans, results, and traceability matrices; report test coverage and quality metrics to leadership; communicate blockers and risks transparently

Requirements

What you’ll need

5+ years of hands-on software QA with a track record of:
Test strategy, planning, execution, and maintenance
Comprehensive test documentation and traceability
Advanced test automation (custom frameworks, advanced scripting)
3+ years with automated testing tools – Selenium, Pytest, or equivalent; ability to write custom testing frameworks
Advanced proficiency in a programming language relevant to test automation:
Python (primary for this engagement; Pytest, async testing)
Or Java, C#, Go
Deep knowledge of databases and SQL – execute complex data validation, verify multi-tenant isolation at the DB layer, test RLS policies
CI/CD pipeline expertise – understand how tests integrate into automated deployment workflows; experience optimizing test execution for speed and reliability
Understanding of Agile/Scrum methodologies – ability to drive QA strategies in rapid, iterative development cycles
Proficiency in defect tracking (Jira or equivalent)
Proven leadership – mentor junior engineers, advocate for quality standards, drive process improvements
Exceptional communication skills – articulate complex technical issues to engineers, product, and stakeholders
Self-motivated and detail-oriented – work independently under time pressure, manage multiple priorities
Exceptional English proficiency – work effectively with distributed, global teams.

Benefits

Comp & perks

Medical Insurance benefits as per company policy.
Life Insurance as per company policy
12 days of paid vacation, sick leave and paid holidays as per local law
Paternity and maternity leave as per as per local law
Marriage, bereavement and graduation leaves as per company policy
Sick leave and paid holidays as per local law
Christmas bonus as per local law
Saving Fund “Asociacion Solidarista”
Beach house (Managed by the Asociacion Solidarista)
Discounts in local shops
Direct deposit of payroll.
Paid professional certifications

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Test StrategyTest DocumentationAutomated Testing ToolsPythonSQLCI/CD IntegrationDefect TrackingCustom Testing FrameworksData ValidationSemantic Validation

Soft Skills

Exceptional CommunicationMentoringSelf-MotivatedDetail-OrientedCollaboration