FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
QA/Test Engineer
Weekday (YC W21)QA/Test Engineer ensuring reliable evaluation benchmarks for pioneering AI models. Collaborating with researchers to validate complex evaluations and strengthen testing methodologies.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in Quality Assurance and Test Engineering, with a strong focus on designing test cases and validating complex software systems. Proficient in Python and Git, with a solid understanding of AI evaluation methodologies and the ability to communicate technical findings effectively.
Highest-signal resume keywords
Quality AssuranceTest EngineeringPython ProficiencyGit ProficiencyAI Evaluation
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Test Case DesignSoftware DebuggingComplex Workflow ValidationAnalytical ThinkingProblem-SolvingAttention to Detail
Soft Skills
Clear Written CommunicationIndependent WorkTask Management
Certifications & Qualifications
Master's DegreePhD
Industry Keywords
AI SystemsMachine Learning ModelsEvaluation BenchmarksTechnical Problem Solving
Tech Stack
Tools & technologiesPython
About the role
Key responsibilities & impact- Join a pioneering AI initiative focused on building the next generation of evaluation benchmarks for frontier AI models.
- Ensure every benchmark is reliable, reproducible, and accurately measures real AI capabilities.
- Review complex, multi-step evaluation tasks, validate their correctness, identify edge cases, and strengthen testing methodologies before benchmarks are deployed.
- Collaborate closely with AI researchers and task authors to improve evaluation quality, eliminate ambiguity, and ensure benchmark integrity.
Requirements
What you’ll need- Master's degree, PhD, or equivalent practical experience in a STEM discipline involving software engineering, research, or advanced technical problem solving.
- Minimum 1 year of professional experience in Quality Assurance, Test Engineering, Software Engineering, Research Engineering, or a related technical field with strong quality ownership.
- Proven experience designing test cases, validating complex software systems, and debugging end-to-end workflows.
- Strong proficiency in Python and Git, with the ability to troubleshoot unfamiliar codebases and technical environments.
- Excellent analytical thinking, problem-solving skills, and exceptional attention to detail.
- Experience documenting bugs, test strategies, and technical findings with clear written communication.
- Experience evaluating AI systems, machine learning models, or AI-generated outputs is preferred.
- Ability to work independently while managing multiple complex tasks with minimal supervision.
- Ability to commit approximately 35 hours per week on a consistent basis.
Benefits
Comp & perks- 🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account Weekday (YC W21) Website LinkedIn All Job Openings 11 - 50 employees Founded 2021 💼 Consulting 👥 HR Tech ☁️ SaaS Consulting
- HR Tech
- SaaS Weekday is a modern recruitment platform that combines AI technologies with a vast database of potential candidates, aiming to streamline the hiring process for companies in India. They offer various services, including a proactive outreach approach that helps employers connect with top talent, as well as tools for candidates to easily apply for jobs. Weekday's emphasis on candidate engagement through multiple channels, including email, WhatsApp, and phone calls, sets it apart in the competitive landscape of recruitment agencies. QA/Test Engineer Job not on LinkedIn 🔥 3 minutes ago 🇺🇸 United States – Remote 💵 60 - 90 / hour ⏳ Contract/Temporary 🟢 Junior ⚙️ Software Development Engineer in Test (SDET) Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
- Join a pioneering AI initiative focused on building the next generation of evaluation benchmarks for frontier AI models.
- Ensure every benchmark is reliable, reproducible, and accurately measures real AI capabilities.
- Review complex, multi-step evaluation tasks, validate their correctness, identify edge cases, and strengthen testing methodologies before benchmarks are deployed.
- Collaborate closely with AI researchers and task authors to improve evaluation quality, eliminate ambiguity, and ensure benchmark integrity. 🎯 Requirements
- Master's degree, PhD, or equivalent practical experience in a STEM discipline involving software engineering, research, or advanced technical problem solving.
- Minimum 1 year of professional experience in Quality Assurance, Test Engineering, Software Engineering, Research Engineering, or a related technical field with strong quality ownership.
- Proven experience designing test cases, validating complex software systems, and debugging end-to-end workflows.
- Strong proficiency in Python and Git, with the ability to troubleshoot unfamiliar codebases and technical environments.
- Excellent analytical thinking, problem-solving skills, and exceptional attention to detail.
- Experience documenting bugs, test strategies, and technical findings with clear written communication.
- Experience evaluating AI systems, machine learning models, or AI-generated outputs is preferred.
- Ability to work independently while managing multiple complex tasks with minimal supervision.
- Ability to commit approximately 35 hours per week on a consistent basis. Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Is Remote Rocketship legit? Privacy policy Terms of service Job board SEO course Remote Job Search MasterClass AI Apply Copilot OpenClaw job finder Find jobs using your resume Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs