Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 109 days ago

AI治理网关工程师

bqsz5qltsd5/index24 open roles

Where
Shanghai, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowAI治理网关工程师bqsz5qltsd5/index · Shanghai, Chinese Mainland

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on bqsz5qltsd5/index's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.3% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.3%7 days
  4. 19.3%14 days
  5. 35.6%30 days
  6. 57.8%60 days
This job: posted 109 days ago

The posting

一、岗位职责 1. AI 治理网关核心研发与架构设计 1. 对标OpenRouter、Portkey等行业标杆，构建兼具高可用、高并发、高扩展性的技术体系，支撑产品从MVP到行业头部的全周期迭代。 2. 基于Go语言主导AI网关核心模块开发，负责请求路由、流量管控、协议转换等核心功能实现 3. 基于Envoy构建高性能数据平面，设计控制平面与数据平面的交互逻辑，优化网关转发性能 2. 大模型服务适配与链路优化 1. 设计 AI 治理网关与大模型推理/训练服务对接方案，支持多模型版本管理、A/B测试、智能路由 2. Agent全生命周期运行时治理能力，包括断点续跑、语义缓存、上下文压缩、无效循环拦截等核心降本机制 3. 实现网关层模型调用鉴权、配额管理、成本计量核心能力 3. 高可用与可观测性建设 1. 搭建全链路监控体系，实现请求追踪、指标监控、异常告警 2. 主导网关容灾方案设计，规避单点故障，保障整体服务可用性 3. 实现熔断、降级、限流策略，保障大模型服务稳定调用 4. 探索 AI Agent 网关业务场景，基于 MCP、A2A 协议完成方案设计与落地赋能

二、任职要求 （一）学历与经验 1. 本科及以上，计算机相关专业 2. 3-5年后端开发经验：3年以上Go开发经验 + 2年以上Envoy/同类Proxy网关研发经验 4. 熟悉K8s生态：服务编排、服务发现、Ingress控制器原理与落地 5. 行业认知匹配：深入理解大模型推理网关、LLM中间件、Agent基础设施赛道，熟悉OpenAI、Anthropic等主流大模型API协议，有多模型路由、推理调度、容灾降级相关项目经验 6. 技术深度达标：懂大模型推理优化原理，接触过Token压缩、语义缓存、模型分级调度等降本方案，有推理侧性能优化、成本优化的实操经验 （二）核心技术能力 1. Go深度精通：并发编程、内存调优，熟练Gin、Go-Micro主流框架 2. Envoy底层掌握：架构原理、配置模型、扩展机制，可二次开发与定制配置 3. K8s深度实践：掌握K8s API、CRD、Operator模式，可基于K8s搭建网关自动化运维体系 4. 网络协议：熟悉HTTP/2、gRPC原理，具备网络性能调优实战经验 5. 分布式存储：Redis、etcd在网关场景落地（分布式限流、配置同步等） 优先加分项 1. 拥有 Nginx / Envoy / Higress / Istio 等开源网关二次开发、架构改造、深度性能优化经验。 2. 在万级QPS高并发网络、全局流量调度、底层协议优化任一方向有深度技术沉淀。 3. 对 AI 领域有深度思考，具备 AI Agent 网关落地实操经验，熟悉 MCP、A2A 协议。 4. 有大规模集群、全球化网关、全链路容灾体系完整搭建落地经验。

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against bqsz5qltsd5/index's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on bqsz5qltsd5/index's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    bqsz5qltsd5/index's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.