Toloka

QA Engineer

• Coordinate quality standards, guideline updates, and feedback loops across QAs, experts, and vendors to ensure consistent interpretation and execution.
• Coordinate coding pilot projects for new potential partners.
• Design unique pilot pipelines to test potential partners.
• Assign coding tasks ensuring alignment with agreed languages (primarily Python, Java, or JavaScript).
• Create and manage collaboration platform spaces for partners during pilots and handle task-related queries.
• Ensure task designs allow for comparison of model-generated answers and prompt engineering assessment (when needed).
• Prepare reports and recommendations to inform vendor and partnership decisions.
• Serve as the primary point of contact for partner and expert queries during pilot and production phases.

Freelance QA Analyst