Skip to content

Open nowPosted 41 hours ago

Base Labs Research Scientist - RL Environments

Baseten108 open roles

Pay
$210 – $285 an hour
Where
San Francisco
Work mode
Hybrid
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowBase Labs Research Scientist - RL EnvironmentsBaseten · San Francisco
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Baseten's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

14.5% of postings close within 7 days. Measured by our own scanner across the market. Baseten postings stay open a median of 74 days.

Share of postings closed within
  1. 2.2%1 day
  2. 4.8%3 days
  3. 14.5%7 days
  4. 23.2%14 days
  5. 39.9%30 days
  6. 59.3%60 days
This job: posted 41 hours ago

Baseten median: 74 days open

The posting

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

ABOUT BASE LABS

Base Labs is Baseten’s research lab, working to advance and democratize open-source intelligence. We publish our research, methods, and results so others can inspect, reproduce, and build on them. Baseten’s training and inference infrastructure gives us a place to test ideas at scale, while our work with companies deploying models keeps us close to the problems those models need to solve.

THE ROLE

Models learn from the environments we give them. If a reward is easier to exploit than a task is to solve, a model can learn the shortcut. If a task measures the wrong capability, a higher score tells us little about progress. Building good environments requires decisions about what to teach, how to measure it, and how to establish whether it transfers.

As a Research Scientist at Base Labs specializing in RL environments, you will create open environments and study how models learn from them. You will design tasks and rewards, develop methods for generating and calibrating environments at scale, and run the training experiments needed to understand their effects.

There is substantial reinforcement learning research in this work. We want to understand how task diversity affects generalization, how curricula should change as models improve, and which reward structures produce reliable learning. Your findings will inform both the environments we release and the broader lab’s training research.

RESPONSIBILITIES

- Identify capabilities and failure modes worth studying, informed by real model use. These may include software development, tool use, scientific reasoning, and following complex instructions.

- Design task distributions, interactions, rewards, and verifiers together. Establish that tasks are solvable and that success depends on the intended capability. Investigate shortcuts, ambiguous instructions, and weaknesses in grading.

- Build methods that scale environment creation without weakening the quality standard. Study how to generate diverse tasks, calibrate difficulty, and detect defects before they spread through a large training pool.

- Run RL experiments to measure learning and transfer. Compare curricula, task mixtures, and reward designs; investigate failed runs and unexpected behavior; test whether improvements hold on unseen tasks.

- Develop evaluation methods that distinguish capability differences from sampling noise, grader errors, or artifacts of the agent’s tools and execution setup. Preserve the evidence needed to reproduce and challenge your conclusions.

- Work with safety researchers on environments that reveal reward hacking and misalignment, and test ways to teach more reliable behavior.

- Release environments, datasets, training recipes, and research findings that other teams can use. Make their assumptions, limitations, and measured effects clear.

WHO WE'RE LOOKING FOR

We look for evidence that you can choose a useful research question, design an informative experiment, implement it, and reason carefully about the result.

You should bring depth in a relevant area such as reinforcement learning, model evaluation, agent systems, synthetic data, or experimental methodology. You should be comfortable writing the code needed to build environments, run experiments, and inspect failures in detail. Experience with LLM training is valuable, as is experience building something that other researchers use.

Your evidence might be a paper, an open-source project or a strong experimental investigation. We also welcome exceptional people from adjacent fields. A PhD or a previous Research Scientist title is not required.

WORKING HERE

We are hiring across levels, with scope matched to experience. You will work closely with research engineers, applied researchers, and the wider Base Labs team. Senior hires will help establish research directions and mentor others. Everyone will contribute to the environments, methods, and published evidence on which the program grows.

BENEFITS

- Competitive compensation, including meaningful equity

- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents

- Flexible PTO policy

- Paid parental leave

- Fertility and family-building stipend through Carrot

- (U.S. only) Company-facilitated 401(k)

- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Baseten's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Baseten's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Baseten's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.