Software Engineer – Test

Roadie

Software Engineer in Test automating data science microservices for Roadie, a logistics and delivery platform. Building reliable regression suites, validating releases, and improving software quality across the delivery lifecycle.

Posted 8/11/2026full-timeRemote • 🇺🇸 United StatesMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and maintaining automated test infrastructure, with a strong focus on performance, reliability, and stability of test suites. Proficient in coding with Python and experienced in testing APIs, databases, and cloud solutions, while championing quality throughout the software development lifecycle.

Highest-signal resume keywords

Python Coding ExperienceAutomated Testing MethodologiesAPI TestingCI/CD Tools ExperienceTest Frameworks Proficiency

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

PythonRubyBashJavaScriptSQLAutomated TestingPerformance TestingData Science ConceptsMachine Learning Model TestingMonitoring Tools

Soft Skills

Troubleshooting SkillsCommunication SkillsAbility to Work in Fast-Paced Environments

Tools & Technologies

PytestGrafanaNew RelicCircleCIGitHub ActionsGitHubJIRAPostmanAWSKafka

Industry Keywords

Quality AssuranceSoftware Development LifecycleAutomated Regression TestingEnd-to-End System TestingDefect Management

Tech Stack

Tools & technologies

AWSCloudGrafanaJavaScriptKafkaMicroservicesPythonRubySQL

About the role

Key responsibilities & impact

Build robust test infrastructure for automated regression testing of data science microservices
Troubleshoot and resolve automation issues across multiple environments
Improve the performance, reliability, and stability of automated test suites
Develop and execute comprehensive test strategies and high-impact test cases
Review product requirements for alignment with design and quality guidelines
Conduct end-to-end system testing and post-deployment validation with software and test engineers
Identify, isolate, document, and verify product defect fixes
Champion quality throughout the software development lifecycle

Requirements

What you’ll need

3+ years of experience in a developer, SDET, or QA automation role
3+ years of coding experience in Python preferred; Ruby, Bash, or Javascript a plus
Experience testing APIs and databases
Experience with testing frameworks, preferably Pytest
Experience with monitoring tools such as Grafana, New Relic, or similar
Experience with CI/CD tools such as CircleCI, GitHub Actions, or similar
Ability to write and analyze SQL queries
Experience with cloud solutions such as AWS
Experience with GitHub, JIRA, and Postman
Background writing clean, stable, maintainable code
Strong understanding of testing methodologies and automated testing approaches
Excellent troubleshooting and communication skills
Ability to operate in a fast-paced environment with short release cycles
Must be authorized to work for any employer in the U.S.; this role is not eligible for visa sponsorship
Bonus: familiarity with performance testing and related tools
Bonus: familiarity with data science concepts
Bonus: experience testing ML models
Bonus: experience with Kafka, Groundcover, Sentry, and MLflow
Bonus: understanding of the full application development lifecycle

Benefits

Comp & perks

Competitive total rewards package
100% company-paid health insurance for yourself
401(k) with company match
Tuition & student loan repayment assistance
Remote-first environment
Unlimited PTO
Inclusive family leave policy that supports all new parents
Paid Wellness Days in addition to Company holidays
Monthly WFH stipend
Paid sabbatical leave
The technology you need to get the job done