Skip to content

Open nowPosted 4 days ago

Research Engineer

Gauntlet6 open roles

Pay
$175,000 – $195,000 a year
Where
New York City / San Francisco / Los Angeles / Remote
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowResearch EngineerGauntlet · New York City / San Francisco / Los Angeles / Remote
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Gauntlet's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

13.8% of postings close within 7 days. Measured by our own scanner across the market. Gauntlet postings stay open a median of 70 days.

Share of postings closed within
  1. 2.2%1 day
  2. 4.7%3 days
  3. 13.8%7 days
  4. 22.3%14 days
  5. 37.8%30 days
  6. 59.0%60 days
This job: posted 4 days ago

Gauntlet median: 70 days open

The posting

The role

Gauntlet is looking for an AI Research Engineer to help improve how we build, evaluate and use AI agents across the business.

We already have agents running in production, including Aria, our in-house generalist agent. They're used across research, engineering and business workflows, and we've learned a lot from seeing how they perform in practice. Some tasks work extremely well; others produce inconsistent results, and changes to models or tooling can introduce unexpected problems. Today, much of that feedback is still subjective. We want to build a more systematic way of understanding what works, what doesn't and why.

A major part of this role will be building the evaluation frameworks that allow us to measure agent performance on real tasks. You'll work with our engineers, quantitative researchers and other teams to understand where agents struggle, turn those observations into measurable experiments, and use the results to improve the systems we're building.

You'll also contribute directly to our existing agents and internal tooling. Initially, the work will be more engineering-focused as you get familiar with our systems, shipping improvements and integrations that teams can use. Over time, you'll take on more open-ended research, helping us develop better approaches to evaluation, agent behaviour and infrastructure.

We're also thinking beyond individual agents. One of our longer-term goals is to build a shared system of knowledge and reusable skills that our agents can draw from and improve over time. You'll play an important role in developing that infrastructure and how we evaluate its effectiveness.

This is an applied research role with a meaningful engineering component. We're looking for someone who enjoys investigating difficult problems, can design good experiments and is comfortable building and shipping the solutions that come out of them.

About Gauntlet

Gauntlet builds the financial systems of the future. While much of onchain finance is focused on point solutions, we operate across the entire stack to offer best-in-class vault products. Today we serve over $1.7B in client TVL across some of the largest fintechs/neobanks, protocols, exchanges, and capital allocators in crypto - and, increasingly, traditional asset management. Our team brings together traditional finance and crypto-native expertise to deliver durable, sophisticated products for institutional clients moving onchain.

Why this role is different

What you'll do;

  • Build evaluation frameworks for AI agents, including datasets, sandbox environments and metrics that measure performance on real-world tasks.
  • Design experiments to compare models, agent harnesses, tools and execution environments, identifying regressions and understanding the trade-offs between performance, reliability and cost.
  • Work with teams across Gauntlet to turn qualitative feedback about agent behaviour into concrete research questions, experiments and measurable outcomes.
  • Investigate agent failures, understand whether problems come from the model, harness, tooling or prompting, and develop ways to improve performance.
  • Build and improve agent harnesses, internal tools and integrations, including contributing to Aria and other agents used across the business.
  • Help develop shared knowledge and reusable skills across agents, creating systems that can learn from previous work and improve over time.
  • Work alongside Infrastructure and Security to ensure agents can operate reliably and safely within our production environment.

What we're looking for;

  • Hands-on experience building, evaluating or improving LLM models or agents, whether through professional work, applied research, open-source contributions or substantial personal projects.
  • Strong Python skills and good software engineering fundamentals. You're comfortable writing production-quality code and understand the importance of testing, maintainability and reliability.
  • Experience with applied research, machine learning or data science, including designing experiments, working with datasets and drawing conclusions from results.
  • A good understanding of how LLM agents work beyond prompting, including tool use, harnesses, context management and common failure modes.
  • The ability to take an open-ended problem, break it down into testable questions and work independently towards a solution.
  • Experience building tools or systems that other people use, with an understanding of how to evaluate their effectiveness beyond technical benchmarks.
  • Comfort working across research and engineering, collaborating with different teams and adapting as priorities change.
  • Genuine interest in AI agents and how they can be made more capable, reliable and useful.

Nice to have;

  • Experience building LLM evaluation pipelines, benchmarks, reinforcement learning environments or model testing infrastructure.
  • Contributions to open-source agent frameworks, harnesses, evaluation datasets or benchmarks.
  • Experience with agent frameworks such as Hermes, OpenClaw or similar tools.
  • Experience in applied ML research, model training, fine-tuning or reinforcement learning.
  • An advanced degree or postgraduate research experience in computer science, mathematics, statistics, machine learning or a related field.
  • Experience in financial markets, quantitative research, DeFi or risk modelling.
  • Familiarity with AI security considerations, including access controls, prompt injection and data protection.

Benefits & Perks;

  • Remote first — work from anywhere in the United States
  • Regular in-person company retreats and cross-country "office visit" perk
  • 100% paid medical, dental, and vision premiums for employees
  • $1,000 WFH stipend
  • Monthly reimbursement for home internet, phone, and cellular data
  • Unlimited vacation
  • 100% paid parental leave of 12 weeks
  • Fertility benefits
  • Opportunity for incentive compensation

Please note at this time our hiring is reserved for potential employees who are able to work within the contiguous United States and Canada. Should you need alternative accommodations, please note that in your application.

The national pay range for this role is $175,000 - $195,000 base plus additional On Target Earnings potential by level and equity in the company. Our salary ranges are based on paying competitively for a company of our size and industry, and are one part of many compensation, benefits and other reward opportunities we provide. Individual pay rate decisions are based on a number of factors, including qualifications for the role, experience level, skill set, and balancing internal equity relative to peers at the company.

#LI-Remote

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Gauntlet's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Gauntlet's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Gauntlet's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.