Skip to content

Open nowPosted 156 days ago

具身智能大模型训练系统开发与优化实习生

agirobot/internrecruitment362 open roles

Where
Shanghai, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen now具身智能大模型训练系统开发与优化实习生agirobot/internrecruitment · Shanghai, Chinese Mainland
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on agirobot/internrecruitment's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

11.8% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.1%1 day
  2. 4.4%3 days
  3. 11.8%7 days
  4. 18.6%14 days
  5. 35.6%30 days
  6. 45.1%60 days
This job: posted 156 days ago

The posting

将会参与如下四个典型训练系统优化方向工作(包括但不限于下面四个方向) 参与方向一:支撑大规模预训练/微调的高效稳定运行 关键任务: 1. 参与千卡级别分布式训练集群的框架优化,确保训练任务在大规模集群上的稳定性(任务失败率 < xxx%)和可恢复性(断点续训时间 < xxx分钟) 2. 优化训练任务的吞吐量(Throughput),相比基线提升至少 20% 3. 参与至少一种并行策略(数据并行、模型并行、流水线并行、MoE并行)的框架级实现或深度优化

方向二:降低大模型训练显存占用,支持更大规模模型 关键任务: 1. 集成或优化至少一种显存节省技术(ZeRO-1/2/3、重计算(Activation Checkpointing)、混合精度训练),使相同GPU下的可训练参数量提升 30% 以上 2. 参与FlashAttention、Flash-FFN等高性能算子在分布式训练框架中的集成与适配 3. 验证并对比不同并行策略组合(如 FSDP + 张量并行)的显存效率与计算效率

方向三:优化跨节点通信效率,降低通信开销 关键任务: 1. 使用 NCCL 或 CANN ACL profiling工具分析通信瓶颈(AllReduce、AllGather等),并提出至少 2 项有效优化方案 2. 参与实现通信与计算的重叠(overlap)优化,使通信隐藏比例提升至 50% 以上 3. 探索并验证低比特通信(如 FP8 梯度通信)在训练中的可行性与效果

方向四:完善训练框架的可用性与可观测性 关键任务: 1. 开发或优化训练监控 Dashboard,覆盖多类关键指标(GPU利用率、内存占用、通信耗时、吞吐量、损失曲线) 2. 参与实现训练任务的自动容错与恢复机制,支持节点级/进程级故障自动重调度 3. 撰写至少内部技术文档/最佳实践指南,帮助算法团队更高效使用训练框架

1. 熟悉计算机体系结构,理解CPU/GPU/NPU、内存层级、PCIe/NVLink等硬件互联架构; 2. 熟练掌握 C/C++ 和 Python,有良好的工程能力; 3. 熟悉 PyTorch 分布式训练生态(DDP、FSDP、DTensor、Torch.compile等); 4. 了解大模型典型架构(Transformer、Attention、MoE、MHA/GQA/MQA等);

分布式系统方向(满足一项或多项) 1. 有分布式训练实际经验,熟悉NCCL、MPI、GLOO等通信库; 2. 了解或使用过Megatron-LM、DeepSpeed、FairScale、MindSpeed等大规模训练框架; 3. 熟悉集合通信原语(AllReduce、AllGather、ReduceScatter、All2All等),理解其在模型并行中的应用; 4. 有集群调度系统经验(Slurm、Kubernetes、Ray)者优先;

性能优化方向(加分项) 1. 有CUDA或CANN开发经验,熟悉GPU/NPU编程模型; 2. 熟悉训练性能profiling工具(Nsys、Nsight Compute、PyTorch Profiler、Tracing); 3. 了解FlashAttention、AllGatherMatMul、MatMulReduceScatter、MatMulAllReduce等高性能算子实现原理;

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against agirobot/internrecruitment's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on agirobot/internrecruitment's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    agirobot/internrecruitment's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.