Skip to content

Open nowPosted 5 hours ago

Member of Technical Staff - GPU Inference Engineer

Liquid AI28 open roles

Where
San Francisco
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowMember of Technical Staff - GPU Inference EngineerLiquid AI · San Francisco
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Liquid AI's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

14.3% of postings close within 7 days. Measured by our own scanner across the market. Liquid AI postings stay open a median of 53 days.

Share of postings closed within
  1. 2.2%1 day
  2. 4.7%3 days
  3. 14.3%7 days
  4. 23.0%14 days
  5. 39.3%30 days
  6. 59.3%60 days
This job: posted 5 hours ago

Liquid AI median: 53 days open

The posting

Role: Member of Technical Staff - GPU Inference Engineer Team: Research & Engineering Location: San Francisco; Boston; Remote Location Type: Hybrid Employment Type: Full-time

ABOUT LIQUID AI

Spun out of MIT CSAIL, we build general-purpose AI systems that run efficiently across deployment targets, from data center accelerators to on-device hardware, ensuring low latency, minimal memory usage, privacy, and reliability. We partner with enterprises across consumer electronics, automotive, life sciences, and financial services. We are scaling rapidly and need exceptional people to help us get there.

THE OPPORTUNITY

GPU inference sits underneath much of how we build and ship models at Liquid. Evaluation runs, synthetic data generation, and our API service all depend on how fast and how cheaply we can serve Liquid Foundation Models on GPUs, and demand for that work is growing. You will join the small team that owns our GPU serving stack, built on vLLM and SGLang, and make it faster and cheaper to run.

This is a high-ownership role: you will be pointed at whichever inference bottleneck matters most and carry it from profiling to a benchmarked result. The work sits at the serving-framework level rather than in custom CUDA kernels, which is a separate role on the team.

WHAT WE'RE LOOKING FOR

We need someone who:

- Reasons from first principles: Explains why a workload is slow before changing it, working from what the model and the GPU are actually doing rather than from framework defaults.

- Picks up the next problem and owns it: Moves from evaluation throughput to data generation to API serving as priorities shift, and takes each one through to a measured result.

- Makes other teams faster: Works directly with the researchers and engineers who depend on inference, and treats their throughput as the result that counts.

THE WORK

- Own and improve our GPU serving stack on vLLM and SGLang, from configuration and scheduling choices to changes in the frameworks themselves

- Speed up large-scale evaluation and synthetic data generation, and design the inference pipelines those workloads run on

- Select, profile, and benchmark the inference engine behind our API service, and adapt the API layer around it

- Integrate Liquid Foundation Models into vLLM, SGLang, and Hugging Face Transformers, and maintain those public integrations as models and frameworks change

- Diagnose throughput and latency problems alongside the researchers and serving engineers who hit them

EXPERIENCE & CAPABILITIES

What you'll need:

- Hands-on experience running LLM inference on GPUs with a serving framework such as vLLM or SGLang, beyond default configuration

- First-principles understanding of LLM inference: the transformer forward pass, autoregressive decoding on a GPU, and the latency, throughput, and memory trade-offs that follow

- Solid grasp of GPU fundamentals as they bear on inference. You do not need to have written CUDA kernels

- Experience profiling and benchmarking inference workloads and acting on what the numbers show

- Strong Python and PyTorch, and comfort reading and changing large open-source codebases

Helpful, not required:

- Merged contributions to vLLM, SGLang, or FlashInfer

- Lower-level GPU optimization experience, such as CUDA or Triton kernels

- Experience building high-throughput batch inference for evaluation or synthetic data generation

WHAT SUCCESS LOOKS LIKE (YEAR ONE)

- Evaluation and synthetic data generation run measurably faster and at lower cost per token on the same hardware, freeing GPU capacity for other work

- The inference engine and configuration behind our API service are chosen on benchmark evidence, and have been profiled and tuned for latency and throughput

- Liquid models run correctly and efficiently in the public serving frameworks and libraries our users rely on, including vLLM, SGLang, and Transformers

WHAT WE OFFER

- Problems standard stacks don't solve: Our hybrid architectures do not drop into off-the-shelf serving frameworks unchanged, and the inference you speed up feeds how every Liquid model is evaluated and trained. High ownership from day one. [INFERRED -- review this line]

- Compensation & Equity: Competitive base salary plus equity, so you share in what we build. Final offers reflect skills, experience, and location.

- Time Off: Unlimited PTO, plus company-wide Refill Days, long weekends when the whole company rests together.

- Health & Wellbeing: Comprehensive health coverage, with details varying by location.

- Paid Leave: Paid leave for pregnancy, parenting, medical needs, and caring for family.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Liquid AI's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Liquid AI's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Liquid AI's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.