Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 3 days agoWe saw it 100 min after it went up

Software Engineer, Agent Optimization & Evaluation

Reddit156 open roles

Pay
$109,800 – $325,000 a year
Where
Remote - United States
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSoftware Engineer, Agent Optimization & EvaluationReddit · Remote - United States

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Reddit's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

11.3% of postings close within 7 days. Measured by our own scanner across the market. Reddit postings stay open a median of 42 days.

Share of postings closed within
  1. 2.0%1 day
  2. 4.2%3 days
  3. 11.3%7 days
  4. 17.6%14 days
  5. 34.3%30 days
  6. 43.5%60 days
This job: posted 3 days ago

Reddit median: 42 days open

The posting

Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit www.redditinc.com.

We are Software Engineers across multiple levels! The Team

We're building Reddit's next-generation AI developer platform: a best-in-class agent stack that helps every Snoo build, test, review, and ship software efficiently while preserving Reddit's control over quality, costs, and long-term AI strategy. Our optimization harness measures and improves agents across the software development lifecycle by benchmarking models, detecting regressions, optimizing routing, incorporating production feedback, and improving developer productivity.

You'll report to Kyle Maxwell and partner with Platform Engineering, Infrastructure, and Developer Productivity to shape AI-assisted software development across Reddit.

The Role

As a Software Engineer, Agent Optimization & Evaluation, you will lead our agent optimization and evaluation platform. You'll build systems to measure and improve agents' impact on engineering velocity, including Reddit-specific evaluation environments, intelligent model orchestration, and feedback loops that learn from production usage. This hands-on role involves writing production code and building new systems with ownership and autonomy. Strong platform and infrastructure partners will support your work on agent optimization, evaluation, and orchestration.

What You’ll Do:

  • Design and build Reddit's agent optimization harness for evaluating, benchmarking, and improving AI agents across real software engineering workflows.
  • Develop Reddit-specific evaluation environments that accurately measure agent performance against meaningful engineering tasks.
  • Build systems for offline replay, automated evaluation, synthetic task generation, regression detection, and human-in-the-loop feedback.
  • Design model routing and orchestration strategies that optimize for quality, latency, and cost.
  • Define metrics and experimentation frameworks that measure developer productivity and engineering velocity.
  • Build tooling to analyze agent behavior, investigate failures, and accelerate iteration.
  • Partner closely with Platform Engineering, Infrastructure, and Developer Productivity teams to integrate agent capabilities into engineering workflows.
  • Help shape Reddit's long-term strategy for a flexible, model-agnostic agent platform that gives us control over our AI capabilities and economics

You Will Bring:

  • 5-12+ years of engineering experience
  • Extensive experience building and shipping large-scale production software systems.
  • Experience designing evaluation, experimentation, benchmarking, or measurement systems for AI, search, developer platforms, or other complex distributed systems.
  • Strong understanding of modern LLMs, AI agents, and the engineering systems required to deploy them effectively.
  • Experience building systems that optimize across multiple dimensions, including quality, latency, reliability, and cost.
  • Excellent software engineering fundamentals and a passion for building production-quality systems.
  • Ability to operate independently in ambiguous environments and drive technical direction for highly strategic initiatives.
  • Strong cross-functional collaboration skills and experience working across engineering, infrastructure, and platform organizations.

Benefits

  • Comprehensive Healthcare Benefits and Income Replacement Programs
  • 401k with Employer Match
  • Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support
  • Family Planning Support
  • Gender-Affirming Care
  • Mental Health & Coaching Benefits
  • Flexible Vacation & Paid Volunteer Time Off
  • Generous Paid Parental Leave

Pay Transparency:

This job posting may span more than one career level.

In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit https://www.redditinc.com/careers/.

To provide greater transparency to candidates, we share base salary ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies. Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses/credentials, and may vary from the amounts listed below.

The base salary range for this position is:

$109,800—$325,000 USD

In select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews.

During the interview, we will collect the following categories of personal information: Identifiers, Professional and Employment-Related Information, Sensory Information (audio/video recording), and any other categories of personal information you choose to share with us. We will use this information to evaluate your application for employment or an independent contractor role, as applicable. We will not sell your personal information or disclose it to any third party for their marketing purposes. We will delete any recording of your interview promptly after making a hiring decision. For more information about how we will handle your personal information, including our retention of it, please refer to our Candidate Privacy Policy for Potential Employees and Contractors.

Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve. Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If, due to a disability, you need an accommodation during the interview process, please let your recruiter know.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Reddit's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on Reddit's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    Reddit's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.