
Project Manager, AI Data
LILT AI
contract
Posted on:
Location Type: Remote
Location: Argentina
Visit company websiteExplore more
Tech Stack
About the role
- Manage the full lifecycle of AI data projects, from scoping and guidelines creation to data delivery and post-mortem analysis.
- Oversee large-scale data pipelines for multilingual data collection (audio, text, image) and LLM evaluation (RLHF, SFT, ranking, and safety testing).
- Forecast capacity needs and manage the allocation of internal and external workforce (vendors, crowdsourced contributors) across multiple time zones and languages.
- Rigorously monitor and report on key performance indicators, including volume of data processed per hour/day, accuracy scores, Inter-Annotator Agreement (IAA), and gold-set performance.
- Build and maintain dashboards to visualize project health and flag bottlenecks in real-time.
- Manage relationships with data experts and crowd pools, ensuring adherence to SLAs regarding localized nuances and linguistic accuracy.
- Liaise with Applied AI Technical Ops teams. Translate technical requirements into clear, actionable guidelines for non-technical annotators.
Requirements
- 3-5+ years of project management experience, specifically within AI/ML data operations.
- Strong understanding of LLM training processes (Pre-training, SFT, RLHF) and evaluation methodologies (Human-in-the-loop, red teaming).
- Advanced proficiency in Excel/Google Sheets; ability to write SQL queries to extract and analyze performance data.
- Proven track record using Agile, Scrum, or Kanban methodologies to manage complex workflows.
- Exceptional ability to write clear, unambiguous guidelines for multilingual audiences.
- Fluency in a second language is highly desirable.
- Experience with data annotation platforms (e.g. Scale AI, Super Annotate) and project management tools (e.g. Jira).
Benefits
- Earn money.
- Have fun.
- Advance human knowledge.
- Work on diverse projects from anywhere, any time you want.
- Get paid quickly and fairly.
- Build your professional network in a supportive community.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
AI data project managementdata pipeline managementLLM evaluationSQL queryingdata analysisAgile methodologyScrumKanbandata annotationmultilingual data processing
Soft Skills
project managementguideline writingcommunicationrelationship managementmonitoringreportingcapacity forecastingproblem-solvingcollaborationadaptability