Skip to content

Open nowPosted 6 hours ago

ML Systems, LLM Post-Training

ChipAgents12 open roles

Pay
$150,000 – $350,000 a year
Where
San Jose
Work mode
On site
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowML Systems, LLM Post-TrainingChipAgents · San Jose
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on ChipAgents's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

13.3% of postings close within 7 days. Measured by our own scanner across the market. ChipAgents postings stay open a median of 52 days.

Share of postings closed within
  1. 2.1%1 day
  2. 4.6%3 days
  3. 13.3%7 days
  4. 21.3%14 days
  5. 35.7%30 days
  6. 59.1%60 days
This job: posted 6 hours ago

ChipAgents median: 52 days open

The posting

POSITION OVERVIEW

We are seeking an ML Systems Engineer to optimize the performance and efficiency of large language model inference powering our agentic AI platform. This is a technical role focused on low-level systems optimization. You will implement performance optimizations, build evaluation harnesses, and architect multi-node clusters for training and inference that push the limits of LLM throughput and latency. Your work will directly impact the responsiveness and cost-efficiency of AI agents used by leading semiconductor companies to design chips.

KEY RESPONSIBILITIES

- Design, deploy, and optimize LLM inference systems across multi-node clusters, maximizing throughput and minimizing latency for production workloads.

- Implement and benchmark concrete inference optimizations.

- Profile and analyze inference bottlenecks at the systems level—from GPU kernel execution to memory bandwidth constraints.

- Build robust evaluation harnesses and benchmarking frameworks that measure accuracy, throughput, latency, and resource utilization across various parallelism strategies.

- Collaborate with research scientists to integrate new model architectures and optimizations into production inference infrastructure.

- Investigate and apply emerging techniques from research papers and open-source projects to continuously improve inference performance.

QUALIFICATIONS

- B.S., M.S., or PhD in Computer Science, Electrical Engineering, or a related field (or equivalent experience).

- Experience with large-scale ML systems, GPU computing, or high-performance inference optimization.

- Strong proficiency in Python and C++/CUDA; hands-on experience with SGLang, vLLM, PyTorch, or similar inference frameworks.

- Deep understanding of GPU architecture, memory hierarchies, and parallel computing paradigms.

- Experience deploying and optimizing LLMs in production: model serving, batching strategies, distributed inference, or quantization.

- Strong systems-level debugging and profiling skills; comfort working at multiple layers of the stack from CUDA kernels to application logic.

- Familiarity with distributed computing frameworks (Ray, multi-node training/inference) is a plus.

- Self-directed problem solver who is interested in working on ambitious optimization challenges.

WHY JOIN US

- Work on cutting-edge LLM inference optimization problems with real-world production impact.

- Access to substantial GPU compute resources for experimentation and benchmarking.

- Collaborate with a world-class team spanning AI research, systems engineering, and EDA.

- Shape the performance characteristics of AI systems used by leading semiconductor companies.

WHAT WE OFFER

- $150K/yr – $350K/yr + Offers Equity. We are open to discuss above-scale compensation with exceptional candidates on a case-by-case basis.

- Unlimited PTO and full benefits (medical, vision, dental, 401k).

- Two engineering-centric offices with free parking, private gym, and free lunch, drinks and snacks.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against ChipAgents's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on ChipAgents's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    ChipAgents's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.