Salary
💰 $15 - $25 per hour
About the role
- Analyse and triage GitHub issues across trending open-source libraries
- Set up and configure repositories (including Dockerization and development environment setup)
- Evaluate unit test coverage and quality across projects
- Run and modify codebases locally to assess LLM bug-fixing performance
- Collaborate with researchers to design/select repositories and tasks challenging for LLMs
- (Optional) Lead junior engineers collaborating on evaluation tasks
- Blend hands-on software engineering with AI-focused research, building LLM evaluation and training datasets from public repository histories
Requirements
- 3–8 years of professional software development experience
- Minimum 2+ years of experience with Rust in production environments
- Strong proficiency with Git, Docker, and software pipelines
- Ability to navigate and understand complex, real-world codebases
- Comfortable running, modifying, and testing repositories locally
- Experience Required: 3–8 years overall, with 2+ years in Rust
- Commitment: 20–40 hours/week with some overlap with Pacific Standard Time (PST)
- Work remotely on impactful AI + software engineering projects
- Collaborate with researchers shaping the future of AI-assisted development
- Opportunity to contribute to real-world open-source challenges while influencing LLM training and evaluation
ATS Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
RustGitDockerunit testingsoftware developmentcodebase modificationbug-fixingAI-focused researchLLM evaluationdataset building
Soft skills
collaborationleadershipproblem-solvinganalytical thinkingcommunication