Skip to content

Open nowPosted 181 days ago

Software Engineer, Inference Infrastructure

Rhoda AI45 open roles

Pay
$175,000 – $280,000 a year
Where
Mountain View
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSoftware Engineer, Inference InfrastructureRhoda AI · Mountain View
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Rhoda AI's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

13.7% of postings close within 7 days. Measured by our own scanner across the market. Rhoda AI postings stay open a median of 27 days.

Share of postings closed within
  1. 2.3%1 day
  2. 4.8%3 days
  3. 13.7%7 days
  4. 22.1%14 days
  5. 37.6%30 days
  6. 59.1%60 days
This job: posted 181 days ago

Rhoda AI median: 27 days open

The posting

At Rhoda AI, we’re building the next generation of generalist intelligent robots. We own the full robotics stack from high-performance hardware and robot systems to the infrastructure and state-of-the-art foundation world models that control our robots. Our robots are designed to be generalists capable of operating in complex, real-world environments and handling long-tail edge cases, made possible by our cutting edge research and end-to-end system design. We've raised over $450M and are investing aggressively in model research, infrastructure, hardware development, and manufacturing scale-up to make generalist robotics a reality.

We're looking for a Software Engineer to help build and operate the systems that power our model deployment stack. You'll be responsible for running large foundation models efficiently and reliably across cloud and on-prem environments, with a focus on resource management, scheduling, and infrastructure scalability.

What You'll Do

- Design and operate large-scale infrastructure to run model workloads across cloud and on-prem environments

- Build and maintain Kubernetes-based deployment pipelines for managing distributed ML workloads

- Own resource scheduling and orchestration across GPU clusters — optimizing utilization, workload balancing, and cost-performance tradeoffs

- Integrate and manage ML frameworks and model serving systems (e.g., Triton, Ray Serve, TorchServe) across research and production use cases

- Build tooling for model deployment, versioning, and observability to support fast iteration cycles

- Contribute to the reliability and scalability of the infrastructure stack as model complexity and deployment footprint grow

What We're Looking For

- 3+ years of experience in ML infrastructure, MLOps, or distributed systems

- Strong proficiency with Kubernetes and containerized deployment pipelines

- Experience with GPU orchestration and resource scheduling across large distributed jobs

- Experience with cloud providers (e.g., AWS, GCP) and hybrid cloud/on-prem infrastructure

- Familiarity with ML frameworks (e.g., PyTorch, JAX) and model serving tools (e.g., Triton, Ray Serve, TorchServe)

- Strong debugging instincts and ownership mentality — comfortable driving issues to resolution across the stack

Nice to Have (But Not Required)

- Experience with streaming systems or high-throughput data transport (e.g., Kafka, gRPC, NATS)

- Background in networking, low-latency systems, or network-aware scheduling

- Experience with edge/cloud hybrid deployment patterns and the latency constraints that come with them

- Familiarity with on-robot or embedded inference environments

- Experience with large-scale cluster topology and scheduling systems (e.g., SLURM, Ray, Volcano)

Why This Role

- Own the infrastructure layer that connects our foundation models to real robot behavior — a direct line between your work and what the robot does in the world

- Be part of building the infrastructure stack for one of the most technically ambitious robotics companies in the world

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Rhoda AI's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Rhoda AI's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Rhoda AI's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.