Skip to content

Open nowPosted 7 hours agoWe saw it 81 min after it went up

Research Intern - AI Serving Systems and Hardware - Microsoft Research

Microsoft2,400 open roles

Pay
CA$9,150 – CA$10,170 a month
Where
Vancouver, BC, CA
Work mode
On site
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowResearch Intern - AI Serving Systems and Hardware - Microsoft ResearchMicrosoft · Vancouver, BC, CA
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Microsoft's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

14.3% of postings close within 7 days. Measured by our own scanner across the market. Microsoft postings stay open a median of 22 days.

Share of postings closed within
  1. 2.2%1 day
  2. 4.7%3 days
  3. 14.3%7 days
  4. 23.1%14 days
  5. 39.5%30 days
  6. 59.2%60 days
This job: posted 7 hours ago

Microsoft median: 22 days open

The posting

Overview

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.

We are seeking Research Interns to work where AI serving workloads meet the systems and hardware that run them. Large-model inference is limited by that hardware and by how well the serving stack uses it. Our team works across this boundary, from serving software and graphics processing unit (GPU) communication, through GPU clusters and their interconnects, down to chip architecture, to make AI serving faster, more reliable, and cheaper to build and run. Open problems range from keeping a large serving system running at predictable performance when GPUs, links, or software components fail to designing chips that keep pace with rapidly evolving workloads.

Research Interns will take on a research project in this space, shaped around their background and interests. Expected deliverables include working prototypes or simulators validated on real hardware, measurement studies, and paper submissions to top-tier venues.

Responsibilities

Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.

Additional Responsibilities

  • Measure and characterize large language model (LLM) inference workloads on state-of-the-art GPU hardware, including how they behave when parts of the system fail or degrade.
  • Build prototypes, simulators, or models that test new ideas in serving systems, fault tolerance, GPU communication, or AI hardware.
  • Compare new approaches against existing methods.
  • Document findings and prepare results for publication at top-tier venues.
  • Present the work to technical audiences, both internally and externally.

Qualifications

Required Qualifications

  • Currently enrolled in a Doctorate Degree program in Computer Science, Artificial Intelligence, Machine Learning, or a related STEM field.

Other Requirements

  • Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
  • In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.

Preferred Qualifications

  • Research experience in computer systems, distributed systems, networking, or computer architecture and hardware design.
  • Proficient programming skills in C/C++ and Python.
  • Working knowledge of ML/AI/LLM concepts.
  • Experience designing experiments and writing research papers.

Candidates should have depth of expertise in one or two of the following areas:

  • Experience with GPU microarchitecture, performance modeling, or architectural simulators.
  • Experience with CUDA, RDMA/verbs, or GPU collective communication libraries (e.g., NCCL, MSCCL++, DeepEP).
  • Familiarity with LLM inference systems and serving stacks, including MoE models and expert parallelism.
  • Experience measuring system performance at scale on real hardware.
  • Prior work on fault tolerance or distributed ML systems.
  • Publications at venues such as ISCA, MICRO, ASPLOS, HPCA, MLSys, OSDI, SOSP, NSDI, SIGCOMM, EuroSys, or ML venues such as NeurIPS and ICML.
  • Ability to work both independently and collaboratively in a fast-moving research environment.

Intern - MSR- The typical base pay range for this role across Canada is CAD $9,150 - CAD $10,170 per month.

Find additional pay information here:https://careers.microsoft.com/v2/global/en/canada-pay-information.html

Microsoft accepts applications and processes offers for these roles on an ongoing basis throughout the academic calendar (September - April).

Ce poste sera ouvert pendant au moins cinq jours et les candidatures seront acceptées de façon continue jusqu’à ce que le poste soit pourvu.

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft est un employeur offrant l’égalité d’accès à l’emploi. Tous les candidats qualifiés seront pris en considération pour l’emploi, sans égard à l’âge, à l’ascendance, à la citoyenneté, à la couleur, aux congés médicaux ou familiaux, à l’identité ou à l’expression de genre, aux renseignements génétiques, à l’état d’immigration, à l’état matrimonial, à l’état de santé, à l’origine nationale, à un éventuel handicap physique ou mental, à l’affiliation politique, au statut de vétéran protégé ou au statut militaire, à la race, à l’ethnie, à la religion, au sexe (y compris la grossesse), à l’orientation sexuelle ou à toute autre caractéristique protégée par les lois, ordonnances et règlements locaux applicables. Si vous avez besoin d’aide avec des accommodements religieux et/ou d’un accommodement raisonnable en raison d’un handicap pendant le processus de candidature, apprenez-en plus sur la demande d’accommodement.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Microsoft's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Microsoft's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Microsoft's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.