QA Engineer

Ruby Labs

QA Engineer responsible for owning and validating product experiments at Ruby Labs. Collaborates with Growth team to ensure data integrity and proper release processes.

Posted 6/9/2026full-timeRemote • CzechiaMid-LevelSeniorWebsite

About the role

Key responsibilities & impact

Experiment Validation: Own end-to-end QA validation of experiments from preview environments through production release.
Variant Testing: Validate all experiment variants (A/B/C/etc.) and ensure expected behavior across different user scenarios.
Targeting & Triggers: Verify audience targeting logic, eligibility rules, and experiment trigger conditions.
Analytics Validation: Ensure analytics events, conversions, and experiment metrics are correctly tracked and reported.
User Flow Testing: Validate experiment behavior throughout the entire user journey.
UI/UX Validation: Ensure experiment implementations meet design requirements and provide a consistent user experience.
Production Monitoring: Perform post-release validation using production environments and session replay tools.
Edge Case Detection: Identify unexpected behaviors and issues beyond predefined test cases.
Regression Prevention: Ensure experiments do not negatively impact core product functionality.
QA Sign-Off: Provide clear release recommendations and final QA approval before launch.

Requirements

What you’ll need

Experimentation Experience: Experience testing A/B tests, feature flags, or growth experiments.
Analytics Tools: Experience with Mixpanel, Amplitude, or similar analytics platforms.
API & Backend Knowledge: Ability to validate API responses and investigate backend-related issues.
Session Replay Tools: Experience using session replay or observability platforms for production validation.
Startup Experience: Experience working in fast-moving product-led environments.
Attention to Detail: Strong ability to identify issues across UI, business logic, and data tracking.
Product Thinking: Ability to evaluate features from both a user experience and business perspective.
Ownership Mindset: Takes responsibility for the quality and outcome of released experiments.
Analytical Thinking: Comfortable investigating complex behaviors and uncovering root causes.
Fast-Paced Environment: Ability to manage multiple experiments and priorities simultaneously.
Communication Skills: Clear and structured communication with Product, Growth, Design, and Engineering teams.

Benefits

Comp & perks

Remote Work Environment: Embrace the freedom to work from anywhere, anytime, promoting a healthy work-life balance.
Unlimited PTO: Enjoy unlimited paid time off to recharge and prioritize your well-being, without counting days.
Paid National Holidays: Celebrate and relax on national holidays with paid time off to unwind and recharge.
Company-provided MacBook: Experience seamless productivity with top-notch Apple MacBooks provided to all employees who need them.
Flexible Independent Contractor Agreement: Unlock the benefits of flexibility, autonomy, and entrepreneurial opportunities. Benefit from tax advantages, networking opportunities, reduced employment obligations, and the freedom to work from anywhere.

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

QA validationA/B testinganalytics validationAPI validationbackend knowledgeuser flow testingUI/UX validationregression preventionedge case detectionexperiment metrics tracking

Soft Skills

attention to detailproduct thinkingownership mindsetanalytical thinkingcommunication skills