Skip to content

Open nowPosted 179 days ago

智算云平台后端工程师-太初云

taichuai/index41 open roles

Where
Beijing, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen now智算云平台后端工程师-太初云taichuai/index · Beijing, Chinese Mainland
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on taichuai/index's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.1% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.1%7 days
  4. 19.1%14 days
  5. 35.6%30 days
  6. 52.7%60 days
This job: posted 179 days ago

The posting

岗位职责

核心架构设计:聚焦推理服务与MaaS(模型即服务)模块,遵循Cloud Native与AI Native理念,负责智算云平台核心功能的设计、开发与迭代,支撑大模型的高效部署与稳定调用。

推理服务优化:基于KServe、NVIDIA Triton等推理引擎,设计并优化推理服务架构,实现动态批处理、模型量化、模型预热等关键逻辑,适配GPU/NPU异构算力环境,保障服务的高并发处理能力与低延迟响应。

MaaS全流程建设:负责MaaS服务全流程开发,构建模型仓库与版本管理机制,封装标准化RESTful/gRPC API接口,打通从模型研发到线上推理的完整链路,结合容器化技术实现服务的弹性扩缩容。

异构算力调度:借助Volcano/GPU调度器,参与异构算力资源的管理与调度优化,实现推理请求与底层算力的高效匹配,提升整体资源利用率;依托Kubernetes核心能力(编排、自愈、服务发现),保障服务的长期稳定运行。

稳定性与可观测性:践行DevOps理念,配合CI/CD流水线落地服务自动化部署与迭代;构建服务可观测性体系(日志、指标、链路追踪),落地故障自愈、熔断降级、限流等稳定性能力,及时定位并解决线上性能瓶颈。

技术驱动与创新:独立推进模块设计与实现,撰写高质量技术文档;持续跟进智算领域前沿技术(如vLLM、SGLang、TGI等推理框架演进),推动推理服务与MaaS服务的持续优化与创新。

任职要求

必备条件

 本科及以上学历,计算机相关专业,3年以上后端开发经验。有智算平台、AI云服务、MaaS平台或推理服务开发经验者优先。

 熟练掌握Golang或Python中的至少一种后端语言,熟悉微服务架构,具备扎实的编码能力与良好的代码规范意识。

 深入理解Cloud Native与AI Native理念,熟悉Kubernetes核心原理(调度、网络、存储、RBAC),具有实际的K8s集群使用或管理经验。

 熟悉Docker容器技术及容器运行时(containerd/CRI-O)基本机制,掌握K8s环境下的常见开发与运维实操技能。

 了解AI推理技术栈,熟悉Triton Inference Server或KServe等推理引擎,了解大模型推理的基本流程(Prefill/Decode)及常见优化手段(连续批处理、张量并行等)。

 了解至少一种CI/CD工具(如Jenkins、GitLab CI、ArgoCD、Tekton),熟悉DevOps流程,具备服务自动化部署与迭代的实操能力。

 具备良好的问题排查能力与自驱力,能独立承担模块设计与实现,有优秀的沟通协作能力。

加分项

 有大规模推理服务或MaaS平台商业化落地经验,熟悉主流MaaS产品(如阿里云PAI EAS、火山引擎方舟、HuggingFace TEI等)架构者优先。

 熟悉GPU/NPU芯片特性,有华为Ascend CANN、NVIDIA CUDA开发经验,或精通Volcano调度器优化者优先。

 有Kubernetes Operator、CRD开发经验,或对K8s ApiServer/调度器源码有一定了解者优先。

 参与过Cloud Native、AI Native相关开源项目,或有KServe/Triton推理服务性能优化经验者优先。

 熟悉主流深度学习框架(PyTorch/TensorFlow),能与算法团队高效协同,或有云管平台、可观测性系统(Prometheus、Jaeger、OpenTelemetry)研发经验者优先。

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against taichuai/index's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on taichuai/index's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    taichuai/index's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.