Skip to content

Open nowPosted 61 days ago

Project Lead, AI Model Training

NewtonX8 open roles

Pay
$150,000 – $240,000 a year
Where
Remote
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowProject Lead, AI Model TrainingNewtonX · Remote
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on NewtonX's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.3% of postings close within 7 days. Measured by our own scanner across the market. NewtonX postings stay open a median of 62 days.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.3%7 days
  4. 19.7%14 days
  5. 35.6%30 days
  6. 58.0%60 days
This job: posted 61 days ago

NewtonX median: 62 days open

The posting

About NewtonX

NewtonX is a B2B insights company trusted by the world's most innovative companies to make high-stakes decisions with confidence. We combine a verified network of business professionals with AI-powered research tools to deliver research intelligence faster, more precise, and more defensible than traditional methods.

Our clients include Google, Microsoft, TikTok, DoorDash, Stripe, and Coinbase. Our research has been cited by Fortune, Forbes, TechCrunch, Adweek, and the Wall Street Journal.

NewtonX has raised $47M from investors including Two Sigma Ventures, Third Prime, XFund, and Citi Ventures.

ABOUT THE ROLE

NewtonX is turning the world’s largest verified expert network into the evaluation, post-training, and audit data that enterprises and AI labs need to deploy AI in production. We build high-quality, expert-generated datasets that train and evaluate frontier AI systems — spanning domain eval sprints, custom data solutions, model behavior audits, agentic RL environments, and domain QA-as-a-service.

This business is taking off, and we are expanding our Delivery team to meet it. We are hiring a Project Lead to own client engagements end to end, from scoping through delivery, on our data operations platform. You will be the client’s point of contact and the person accountable for the operational execution and the quality outcome across a portfolio of concurrent projects — many of them complex agentic-workflow evaluations.

Our commercial team wins the business. From the moment it is won, it is yours: you scope it, configure it, run it, defend its quality, and deliver it. When a client asks how it is going, you are the person who answers. When the spec turns out to be wrong at scale, you are the person who fixes it.

You will be joining a small, early Delivery team, working closely with our ML Lead, annotator delivery team, commercial team, and product and engineering. Because the team is still young, you will help build and scale the delivery function itself — the playbooks, quality standards, and processes that everyone who follows you will run on — and you will have direct exposure to NewtonX’s C-level. This is a ground-floor seat in a business we expect to grow extremely quickly, with the career path that comes with it.

Location: Remote (US or Canada) or Hybrid (New York City)

IN THIS ROLE YOU WILL

1. SCOPE AND SET UP EVERY ENGAGEMENT

- Translate the client’s need into a bounded statement of work. Turn a training or evaluation objective into concrete task design, a defined quality bar (defect-rate and inter-annotator agreement targets), an annotator profile, and — for agentic projects — an environment and tool strategy.

- Configure the project on the platform. Stand up the multi-layer quality pipeline, task forms, grading rubrics, annotator enablement, and routing.

- Author the first-draft guidelines and gold set with the ML Lead, and pressure-test them before production starts. Most delivery failures are scoping failures; your job is to catch them here.

2. RUN PRODUCTION

- Own quality, throughput, and cost. Track how each project is performing against its targets, diagnose what is drifting, and act before it reaches the client.

- Manage the annotator pool on your projects. Assignment, layer access, qualification, and performance — working with the annotator delivery team to get the right experts on the right tasks.

- Keep annotators aligned. Run project channels and calibration sessions, handle exceptions and escalations, and adjust configuration as the work reveals what the spec missed.

3. OWN THE CLIENT RELATIONSHIP

- Be the client’s point of contact throughout — scoping calls, mid-project updates, quality escalations, and delivery.

- Manage expectations against scope, and diagnose acceptance issues candidly when they arise. Clients trust the person who tells them early.

- Grow the account from the inside. Surface expansion opportunities and new use cases to the commercial team, and act as the technical subject matter expert on calls when new work is being scoped.

4. DELIVER AND CLOSE OUT

- Assemble and deliver batches on schedule, and own the handoff to the client.

- Run client acceptance testing against agreed criteria, capture sign-off, and trigger the commercial milestone.

- Run the post-mortem and feed what you learned back into guidelines, tooling, and the next scope.

5. BUILD THE MACHINE AS YOU RUN IT

- Turn each engagement into repeatable process. Codify what works into playbooks, templates, and quality standards that the next Project Lead can run from day one.

- Be the voice of delivery to product and engineering. You will be running on a platform that is still being built; what you flag gets built.

WHO YOU ARE

- 3+ years of experience in data labeling, RLHF/SFT, or AI evaluation delivery — you have shipped real annotation or evaluation projects at a data labeling company (Scale, Surge, Mercor, Snorkel, Handshake, Centific, Labelbox, SuperAnnotate, or similar) or inside an AI lab. This is a firm requirement; we are not looking for a generalist project manager.

- An operator who goes into the weeds. You are comfortable owning quality metrics, debugging a stalled queue, and rewriting a rubric that is not holding up in production.

- Client-facing and credible. You can run a scoping call with a technical buyer, deliver bad news without losing the room, and translate operational mechanics into terms a client cares about.

- Analytically rigorous. Data analysis skills using SQL or Python are a strong plus.

- A builder. Processes here are young and some are still manual. You want to stand things up rather than inherit a finished machine.

- Exceptional at holding many threads. You will run several concurrent projects with different clients, quality bars, and annotator pools.

- Adaptable and resilient. Specs change, clients change their minds, and no two weeks look the same. You roll with it and find the new angle.

- Discreet. This role handles annotator personal data and client-confidential information under strict data-security and confidentiality standards; all work stays within approved systems.

- Valid US or Canadian work authorization required. Visa sponsorship is not available for this role.

WHAT WE OFFER

- Competitive compensation: $150-240K total on target compensation + participation in our company stock buying program

- Massive impact: the chance to help build a new business unit from the ground up with direct C-level influence at an extremely fast-growing late-stage startup

- Fast-track career growth toward operational and commercial leadership

- Excellent medical, dental, and vision insurance

- 401k match with immediate vesting

- Health savings/flexible savings account, and pre-tax commuter benefits

- Paid time off: vacation, holidays, sick, and parental leave

- A diverse, collaborative, and positive culture where we invest in and celebrate each other’s success (happy hours, team projects, and retreats)

NewtonX is proud to be an equal opportunity workplace. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity/expression, age, status as a protected veteran, status as an individual with a disability, or any other applicable legally protected characteristics.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against NewtonX's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on NewtonX's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    NewtonX's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.