Toloka

Freelance QA Analyst

Toloka

contract

Posted on:

Location Type: Remote

Location: Netherlands

Visit company website

Explore more

AI Apply
Apply

About the role

  • Coordinate quality standards, guideline updates, and feedback loops across QAs, experts, and vendors to ensure consistent interpretation and execution.
  • Coordinate coding pilot projects for new potential partners.
  • Design unique pilot pipelines to test potential partners.
  • Assign coding tasks ensuring alignment with agreed languages (primarily Python, Java, or JavaScript).
  • Create and manage collaboration platform spaces for partners during pilots and handle task-related queries.
  • Ensure task designs allow for comparison of model-generated answers and prompt engineering assessment (when needed).
  • Prepare reports and recommendations to inform vendor and partnership decisions.
  • Serve as the primary point of contact for partner and expert queries during pilot and production phases.

Requirements

  • Experience in Software Quality Assurance or technical vendor assessments.
  • Experience working with developer or documentation teams, high-volume review queues, and structured quality monitoring systems.
  • Ability to deliver precise, objective feedback on code quality and logic to help developers align with project requirements.
  • Strong understanding of coding languages (Python, Java, JS) and familiarity with additional or less common programming languages.
  • Ability to create and manage structured testing projects and pipelines.
  • Excellent communication skills for vendor interaction and cross-functional coordination.
  • Comfortable using collaboration platforms and organizing technical documentation.
  • Analytical mindset for assessing developer outputs and making recommendations.
Benefits
  • Opportunity to work with cutting-edge AI technology and build your portfolio
  • Flexible working arrangements with ability to determine your own schedule
  • Long-term collaboration potential with a growing global tech company
  • Exposure to international markets and diverse audience segments

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
PythonJavaJavaScriptSoftware Quality Assurancecoding standardstask designmodel-generated answersprompt engineeringstructured testing projectsquality monitoring systems
Soft skills
communication skillsanalytical mindsetfeedback deliverycross-functional coordinationvendor interaction