ML Lead, AI Data Labeling

NewtonX

ML Lead at NewtonX collaborating with AI-focused clients and building domain-specific benchmarks. Engaging technical teams and expanding accounts in B2B insights for innovative companies.

Posted 5/18/2026full-timeRemote • 🇺🇸 United StatesSenior💰 $180,000 - $260,000 per yearWebsite

Tech Stack

Tools & technologies

Python

About the role

Key responsibilities & impact

Serve as the primary technical point of contact for ML, applied science, and product teams at AI-focused clients.
Hold your own in technical conversations.
Translate ambiguous technical requirements into concrete operational specs.
Design and build domain benchmarks for NewtonX-owned domains in high-value verticals.
Work directly with recruiting and operations lead to convert client and benchmark requirements into operational specs.
Sit in client calls alongside Commercial leads.

Requirements

What you’ll need

5 to 8 years of applied ML experience with substantive evaluation, benchmark, or human data work.
Working fluency with modern LLM evaluation: benchmark design, contamination handling, statistical significance, eval harness construction, agentic and tool-use evaluation, RLHF and preference data quality, red-team probe design.
Strong programming foundation. You can read and reason about an eval harness, write Python comfortably, work with model APIs, and prototype scoring pipelines.
Statistical fluency. You know when an effect is real and when it is noise.
Demonstrated client-facing presence.
Light commercial instinct.
Strong written communication.

Benefits

Comp & perks

Excellent medical, dental, and vision insurance.
401k match with immediate vesting.
Health savings/flexible savings account, and pre-tax commuter benefits.
Paid time off: vacation, holidays, sick, and parental leave.
A diverse, collaborative, and positive culture where we invest in and celebrate each other's success (happy hours, team projects, and retreats).

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

applied MLbenchmark designcontamination handlingstatistical significanceeval harness constructionagentic evaluationtool-use evaluationRLHFPythonscoring pipelines

Soft Skills

client-facing presencestrong written communicationlight commercial instinct