About the role
- Evaluation: Rating/assessing the performance of AI models or algorithms based on their output or behavior through a set of evaluative questions.
- Annotation Labeling: Labeling elements of a piece of content rather than the content as a whole.
- Classification: Assigning predefined categories or labels to items.
- Content Quality: Evaluating the perceived quality and/or appropriateness of content.
- Content Understanding: Generating labels to advance understanding of a concept, trend etc.
- Data Augmentation: Creation of additional training data for machine learning models by applying transformations to the original data.
- Grading: Reviewing data and identifying whether or not a product feature works as intended based on the project's guidelines.
- Preference Ranking: Ordering or ranking items based on a set of preferences or criteria.
- Prompt Generation: Creating prompts or questions that will be used to generate responses from a language model.
- Relevance Evaluation: Projects that evaluate the relevance of content based on a relevancy scale.
- Response Generation: Generating responses to prompts or questions using a language model.
- Response Rewrite: Rewriting existing text while preserving the original meaning.
- Response Summarization: Producing concise summaries of longer pieces of text or data.
- Similarity Evaluation: Projects where content is compared in order to drive a determination.
- Transcription: Converting spoken language or audio content into written text.
- Translation: Converting text or spoken language from one language to another.
- Data Collection: Gathering and compiling various forms of data.
Requirements
- A Bachelor’s degree or higher in a humanities specialization is required.
- Advanced degrees are strongly preferred (Master’s or PhD)
- Professional or Expert level proficiency (C1/C2) in English and French
- Remote work within Canada (excluding Quebec)
- Opportunities for flexible work arrangements
- Inclusive environment for all employees and applicants
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
evaluationannotation labelingclassificationcontent quality evaluationdata augmentationgradingpreference rankingprompt generationresponse generationtranscription