Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 3 hours agoWe saw it 78 min after it went up

ML Infrastructure and Performance Engineer, AI Expert (Remote)

Weekday AI

Pay
$90 – $120 an hour
Where
United States
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowML Infrastructure and Performance Engineer, AI Expert (Remote)Weekday AI · United States

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Weekday AI's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

13.9% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.2%1 day
  2. 4.7%3 days
  3. 13.9%7 days
  4. 22.4%14 days
  5. 38.1%30 days
  6. 59.0%60 days
This job: posted 3 hours ago

The posting

This role is for one of our clients

Compensation: $90 - $120 per hour

Location: Remote

Job Overview

We are seeking an experienced ML Infrastructure and Performance Engineer to contribute to the development and advancement of next-generation Generative AI systems. This role is focused on building, optimizing, debugging, and evaluating the infrastructure that powers large language models and other frontier AI systems.

The ideal candidate will have hands-on experience in ML systems engineering, accelerator performance optimization, distributed workloads, or large-scale model serving. Expertise in areas such as custom accelerator kernels, performance profiling, trace analysis, distributed systems debugging, and high-throughput inference is particularly valuable. Experience with JAX, XLA, and TPU-based infrastructure will be a strong advantage.

In this role, you will apply your engineering expertise to create, evaluate, and improve technical tasks and solutions used to train and assess advanced AI models. Your work will help improve how frontier AI systems understand and solve complex ML infrastructure and performance engineering problems.

This is a fully remote opportunity open to candidates worldwide. The engagement will be structured in accordance with applicable local employment and compliance requirements. Candidates must be available for a full-time commitment of 40 hours per week, with no conflicting professional engagements.

Requirements

Key Responsibilities

  • Design challenging technical tasks covering accelerator kernel development, performance profiling, distributed workload debugging, and high-throughput inference serving.
  • Develop complex and adversarial engineering problems that test the capabilities of advanced AI models, including tasks involving accelerator programming and optimization.
  • Create accurate, technically sound reference solutions that demonstrate best practices in ML systems engineering.
  • Evaluate AI-generated solutions for correctness, efficiency, scalability, and practical applicability.
  • Develop detailed technical guidelines and assessment rubrics for kernel optimization, profiler interpretation, distributed systems, and inference performance.
  • Analyze performance bottlenecks across ML infrastructure, compilers, accelerators, and model-serving systems.
  • Provide clear, structured technical feedback to help improve AI model capabilities in ML systems and infrastructure engineering.
  • Collaborate with researchers and fellow subject matter experts to maintain the quality, consistency, and accuracy of AI training and evaluation data.

Required Qualifications

  • At least 2 years of hands-on professional experience in ML systems, ML infrastructure, model serving, accelerator performance engineering, or a closely related field.
  • Practical experience in at least one of the following areas:
  • Accelerator Kernel Programming: Developing or optimizing custom kernels using Pallas, Triton, CUDA, CUTLASS, or similar technologies.
  • Performance Profiling: Working with profiling and trace-analysis tools such as JAX/XLA Profiler, Kineto, torch.profiler, or NVIDIA Nsight.
  • Distributed Workload Debugging: Identifying and resolving performance and execution issues in distributed or accelerator-intensive workloads.
  • LLM Inference Serving: Experience with vLLM, SGLang, TensorRT-LLM, JetStream, KV cache optimization, paged attention, or continuous batching.
  • Production-level experience with JAX and/or PyTorch.
  • Understanding of modern accelerator architectures, including TPUs (v4–v6e), NVIDIA H100/B200, AWS Trainium, or AMD MI300.
  • Ability to analyze and optimize throughput, latency, memory utilization, and computational efficiency.
  • Demonstrable professional growth and career progression in engineering or infrastructure-focused roles.
  • Availability to commit at least 40 hours per week on weekdays.
  • Excellent written communication skills, with the ability to explain complex technical concepts and engineering decisions clearly.

Preferred Qualifications

  • Experience with JAX, XLA, and TPU-based development environments.
  • Knowledge of custom operators, sharding, and distributed training frameworks such as pjit, shard_map, FSDP, Megatron, or MaxText.
  • Familiarity with compiler and graph-level technologies such as XLA, StableHLO, torch.compile, and MLIR.
  • Experience developing performance benchmarks, technical evaluation frameworks, or engineering assessment rubrics.
  • Exposure to AI model evaluation, synthetic training data generation, or working with frontier AI systems.

Engagement Details

  • Work Arrangement: Fully Remote
  • Geographic Eligibility: Worldwide
  • Commitment: Full-Time, 40 hours per week
  • Schedule: Weekdays
  • Engagement Structure: Employment or engagement through an appropriate local partner, depending on the candidate's country of residence.
  • Availability: Candidates must be able to commit exclusively to this engagement without conflicting professional commitments.
From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Weekday AI's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on Weekday AI's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    Weekday AI's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.