Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 66 days ago

AI推理部署工程师

xskydata/career26 open roles

Where
Shenzhen, Guangdong, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowAI推理部署工程师xskydata/career · Shenzhen, Guangdong, Chinese Mainland

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on xskydata/career's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.3% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.3%7 days
  4. 19.3%14 days
  5. 35.6%30 days
  6. 57.8%60 days
This job: posted 66 days ago

The posting

1、推理服务部署运维：负责GPU服务器、AI算力集群环境部署调试，管理NVIDIA驱动/CUDA/NCCL/容器工具链版本兼容；基于 vLLM / SGLang / LMCache搭建推理服务，部署 Qwen / DeepSeek / GLM / MiniMax 等主流大模型（单机/多节点），支持私有化内网交付。 2、推理性能优化：评测 TTFT、TPOT、吞吐量、显存占用等指标；设计 TP/PP/DP/EP 并行方案；围绕 KV cache、量化（FP16/BF16/FP8/AWQ/GPTQ/GGUF/INT4/INT8）、长上下文、MoE 路由等方向，持续优化推理吞吐与延迟。 3、工程化交付：完成从裸机环境到模型API的完整交付链路；将推理系统部署进客户受控内网；协同网络工程师调试 NCCL 跨节点通信。 4、文档与监控：输出部署文档、API手册、测试报告、故障复盘；搭建 Prometheus/Grafana 监控体系，实现异常告警与自动恢复。

必备条件： 1、计算机、AI 等相关专业，本科及以上，2年以上 GPU 服务器 / 大模型部署经验。 2、精通 NVIDIA 驱动/CUDA/NCCL/容器工具链的版本兼容管理，能独立解决环境冲突问题。 3、熟悉 vLLM / SGLang 至少一种，理解推理机制——不是只调过 API。 4、熟悉主流量化方案（FP16/BF16/FP8/AWQ/GPTQ/GGUF）。 5、具备独立排查 OOM、CUDA 报错、NCCL 通信异常、推理吞吐低等问题能力。 6、熟悉 Shell/Python，能独立完成裸机到 API 的端到端交付。 7、有生产部署意识，理解受控/离线企业环境与实验室环境的差异。

优先加分项： 1、大模型私有化部署 / 多机分布式推理经验 2、Ray Serve / K8s / Slurm 集群运维经验 3、InfiniBand / RDMA / NCCL / HCCL 多机通信调优经验 4、Prometheus / Grafana 监控体系搭建经验 5、高并发推理服务架构设计经验 6、KV cache 优化 / MoE 推理调优 / MLOps 经验

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against xskydata/career's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on xskydata/career's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    xskydata/career's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.