Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 33 days ago

【校招】推理服务研发工程师-系统平台中心

aicarrier/522799209 open roles

Where
Shanghai, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen now【校招】推理服务研发工程师-系统平台中心aicarrier/522799 · Shanghai, Chinese Mainland

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on aicarrier/522799's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.3% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.3%7 days
  4. 19.3%14 days
  5. 35.6%30 days
  6. 57.8%60 days
This job: posted 33 days ago

The posting

1.推理服务后端架构研发：负责AI推理服务的后端架构设计与开发，实现模型加载、请求调度、批处理推理、动态路由、流量管控、超时重试等核心能力，搭建标准化、可复用的推理服务底座。 2.推理性能专项优化：针对大模型推理的吞吐、延时、显存占用、推理速度等核心指标分析推理链路瓶颈（Gateway/Scheduler/Runtime/GPU）进行专项优化，结合业务场景优化KV缓存、动态批处理、模型量化、推理并行策略，提升单机及集群推理并发能力，降低推理部署成本。 3.云原生推理服务化落地：将优化后的推理引擎封装为标准化云原生服务，对接K8s集群，实现推理服务的容器化部署、弹性扩缩容、灰度发布、资源管控，保障线上服务高可用。 4.推理服务监控与问题迭代：基于可观测体系（Metrics/Profiling/Tracing）搭建推理服务全链路监控体系，跟踪线上推理异常、性能瓶颈、报错问题，持续迭代优化引擎与服务架构，提升推理服务稳定性与用户体验。 5.技术调研与方案落地：持续跟进业界开源推理技术、大模型部署新技术、新方案，开展技术调研与POC验证，输出适配业务的推理部署最优方案，推动团队技术架构升级。

1.本科及以上学历，计算机、软件工程、人工智能等相关专业，应届毕业生或有相关实习、科研、项目经历者优先； 2.具备扎实的编程基础，熟悉 Go / C++ / Python 中至少一种语言，掌握数据结构与算法，了解网络编程、并发编程及常见后端开发模式； 3.了解至少一种主流大模型推理引擎或框架，如 vLLM、SGLang、TensorRT-LLM、Dynamo 等，有相关课程、项目、实习或源码阅读经历者优先； 4.了解大模型推理基本原理，包括 Batch、KV Cache、量化、张量并行、流水线并行、PD 分离等技术，对推理性能优化方向有一定理解； 5.熟悉 Linux、Docker 等基础环境，了解 Kubernetes 及云原生基本概念，有模型部署、容器化服务或 GPU 环境实践经验者优先； 6.具备较强的学习能力、问题分析能力和工程实践意识，对大模型推理、AI 基础设施及高性能系统方向有浓厚兴趣，具备良好的团队协作和沟通能力。

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against aicarrier/522799's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on aicarrier/522799's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    aicarrier/522799's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.