Skip to content

Open nowPosted 61 days ago

Member of Technical Staff - Frontier System Modelling

SemiAnalysis53 open roles

Where
San Francisco, CA
Work mode
Hybrid
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowMember of Technical Staff - Frontier System ModellingSemiAnalysis · San Francisco, CA
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on SemiAnalysis's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.3% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.3%7 days
  4. 19.3%14 days
  5. 35.6%30 days
  6. 57.8%60 days
This job: posted 61 days ago

The posting

Employment Type: Full-Time Work Setting: In-office/Remote Work Location: United States, New York, Mexico, San Francisco, Canada Work Hours: Office hours Find out more here: https://semianalysis.com

About SemiAnalysis

SemiAnalysis is an independent research and analysis firm specializing in the Semiconductor and AI industries. Our in-depth coverage spans the entire supply chain, from semiconductor fabrication processes to cutting-edge AI Models, software, and infrastructure. We are recognized as the leading authority on the semiconductor supply chain, with the highest concentration of industry experts within one team, and a deep-rooted passion for delving into the intricacies.

We’re a global team of over 50 analysts, each with extensive networks across the semiconductor supply chain and AI ecosystem, publishing industry shaping articles while participating in 40+ conferences annually.

Our newsletter reaches more than 200,000 subscribers worldwide, including senior management and c-suite leaders at the leading semiconductor and AI companies.

We also offer three core products:

  • Industry Models – we develop and publish industry models on accelerator shipments, datacentre demand and supply, GPU total cost of ownership, and more. We work with hyperscalers, neoclouds, many of the world’s largest hedge funds, and government agencies.
  • Core Research – our public equity markets product, geared towards financial investors, distils our deep technical research and knowledge into key insights on technology and product trends.
  • Consulting and Technical Due Diligence – We conduct custom research and project work to guide key strategic and investment decisions for the largest private equity funds, leading venture capital firms, companies across the AI ecosystem, and government agencies.

Position Overview

We are looking for a highly motivated member of technical staff to join our engineering team to work on system modelling on 100k+ chip AI clusters. This is an unique opportunity to work on an high-visibility open source projects to architecture & model performance for the next generation of AI chips. If you’re passionate about performance engineering, system modelling, first principles, and want to work at the intersection of hardware and software, this is a rare chance to make industry wide impact. As part of the interview process, you'll complete a paid coding challenge designed to reflect typical daily tasks at SemiAnalysis. Competitive Compensation depending on experience, skillset, location & business needs

Responsibilities

  • Develop an complex model in Python to predict performance (MFU, tok/s/gpu, tok/s/user) on current & future AI chip projects across both frontier LLM training & inference models
  • Implement modern parallelism & inference strategies to generate Pareto frontier roofline curves for performance on each chip
  • Develop microbenchmarks across multiple vendors (AMD, NVIDIA, TPU, Trainium) to calibrate the system model to as close to reality as possible
  • Build BoM estimates to model performance per total cost of ownership and performance per watt

Requirements

  • Strong skills in Python
  • Deep understanding about disaggregated prefill, wide expert parallelism, tensor parallelism, pipeline parallelism, sequence parallelism, etc.
  • Experience with frontier MoE training and inference workloads
  • Knowledgeable about GEMM sizes & proportions of wall time & FLOPs on every major operator in an modern transformer
  • Intuition about Amdahl principles, arithmetic intensity, weak & strong scaling
  • Previous experience as an ML engineer or kernel programmer

Growth Areas

  • Develop deep expertise in large-scale system modelling for AI infrastructure, including performance prediction across hyperscale (100k+ chip) clusters
  • Gain a strong first-principles understanding of how hardware, software, and model architectures interact to determine real-world performance
  • Build advanced knowledge of parallelism strategies and scaling techniques across frontier LLM training and inference workloads
  • Strengthen the ability to translate low-level system behavior into high-level performance insights, including cost efficiency and power optimization
  • Gain hands-on exposure to cutting-edge AI hardware across multiple vendors and architectures, staying at the forefront of industry developments
  • Contribute to high-impact open source projects and build visibility within the AI and infrastructure engineering community
  • Take ownership of complex modelling frameworks and drive independent research directions as you grow within the team
  • Develop the ability to influence technical strategy and decision-making through data-driven insights and performance analysis

SemiAnalysis LLC participates in the E-Verify program to confirm the employment eligibility of all newly hired employees. For more information, visit e-verify.gov.

  • E-Verify Poster: https://www.everify.gov/sites/default/files/everify/posters/EVerifyParticipationPoster.pdf
  • Right to Work Poster: https://www.justice.gov/crt/case-document/file/1133936/dl?inline=
From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against SemiAnalysis's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on SemiAnalysis's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    SemiAnalysis's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.