Skip to content

Open nowPosted 13 days ago

大模型框架专家(存算与AI) - 芯片研发

ByteDance19,268 open roles

Where
Beijing, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen now大模型框架专家(存算与AI) - 芯片研发ByteDance · Beijing, Chinese Mainland
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on ByteDance's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

11.5% of postings close within 7 days. Measured by our own scanner across the market. ByteDance postings stay open a median of 9 days.

Share of postings closed within
  1. 2.0%1 day
  2. 4.3%3 days
  3. 11.5%7 days
  4. 18.1%14 days
  5. 35.6%30 days
  6. 44.6%60 days
This job: posted 13 days ago

ByteDance median: 9 days open

The posting

团队介绍:聚焦存算一体芯片设计,主要围绕AI大模型应用场景进行高能效计算技术创新,设计多款基于存算一体架构的高能效AI芯片,突破传统冯・诺依曼架构下的 "内存墙" 瓶颈,提升能效比、降低算力成本。团队具备独立流片与量产落地能力,累计申请专利近300项,核心专利覆盖“底层器件-核心架构-工程落地”全流程。同时与字节各团队算力需求整体协同,更好的发挥存算一体芯片的技术价值,共同为AI业务提供高能效算力底座。

1、围绕存算一体芯片架构,负责云侧大模型训练与推理框架的架构定制、模块开发和性能优化; 2、开发和优化分布式训练能力,包括数据并行、张量并行、流水线并行、上下文并行、混合精度、存储管理及通信计算重叠; 3、开发和优化大模型推理引擎,支持Paged Attention、Prefix Cache、Prefill-Decode分离、投机解码及长上下文推理; 4、优化MoE模型的训练与推理效率,解决专家并行、路由负载均衡、跨卡通信、显存占用和推理部署等问题; 5、从框架执行效率、分布式扩展性和资源利用率角度参与软硬件协同设计,为计算单元、存储层次、高速互联、集合通信、同步机制等系统方案提供软件侧需求与评估; 6、对接AI编译器、算子库和Runtime,定位计算、通信、I/O等瓶颈,协同算法、编译器、算子及硬件团队完成端到端精度校准和性能优化,建设精度、性能、压力测试及回归体系,推动训练和推理框架产品化及规模化部署。

1、计算机、算法、电子工程或相关专业本科及以上学历,具有3年以上C++/Python开发经验,以及AI框架、训练系统、推理引擎或异构计算相关经验,熟悉多线程、异步编程、内存管理和网络通信,具备大型软件系统设计能力; 2、熟悉PyTorch、JAX等深度学习框架,理解计算图、自动微分、自定义算子、设备后端和分布式执行机制,熟悉Transformer、Attention、MoE及大模型训练和生成流程,理解模型并行、Prefill、Decode和KV Cache; 3、在分布式训练、推理引擎、分布式推理或异构Runtime中至少一个方向具有深入经验,熟悉Megatron-LM、DeepSpeed、PyTorch FSDP、vLLM、SGLang、TensorRT-LLM等至少一种框架,具有多机多卡训练、高并发在线推理或GPU/NPU集群优化经验,具有FP8、INT8、INT4、AWQ、GPTQ等低精度训练或量化推理经验; 4、具有CUDA、ROCm或自研NPU开发经验,理解Stream、Event、设备内存、数据传输及异步Kernel Launch,熟悉NCCL/RCCL、RDMA等分布式通信机制,理解通信能力对训练与推理框架的影响; 5、具备计算、显存、通信、调度和I/O性能分析能力,能够推动框架、Runtime与硬件协同优化,参与过GPU/NPU、服务器或高速互联系统的软硬件协同设计,能够从典型模型负载出发评估硬件架构。

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against ByteDance's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on ByteDance's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    ByteDance's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.