Skip to content

Open nowPosted 92 days ago

Agent测试负责人

li/referral786 open roles

Where
Beijing, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowAgent测试负责人li/referral · Beijing, Chinese Mainland
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on li/referral's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

11.8% of postings close within 7 days. Measured by our own scanner across the market. li/referral postings stay open a median of 1 days.

Share of postings closed within
  1. 2.1%1 day
  2. 4.4%3 days
  3. 11.8%7 days
  4. 18.6%14 days
  5. 35.6%30 days
  6. 45.1%60 days
This job: posted 92 days ago

li/referral median: 1 days open

The posting

岗位职责: ① 构建 SalesAgent 领域 Benchmark 行业里没有现成的汽车销售 Agent 评测集,核心维度包括: - 意图识别:判断客户处于哪个购买阶段(初探 / 有意向 / 临近成交 / 售后) - 幻觉检出:识别捏造车型参数、金融政策、配置信息等高风险输出 - 上下文记忆:多轮对话中正确引用客户信息,拒绝"失忆式重复提问" - 话术生成质量:跟进文案、试驾邀约、异议处理是否贴合真实销售语境 ② 设计模型迭代的测试闭环 - 搭建上线前的 Quality Gate:关键场景设定合格阈值,回归不通过不上线 - 构建「全场景 × 多版本」自动化回归框架,重点覆盖性能退化与边缘场景鲁棒性(方言、销售黑话、模糊表达) - 设计 A/B 测试方案,在专家用户小范围验证模型效果(话术采纳率、专家满意度、任务完成率) - Own 标注团队与标注规范,保证 Ground Truth 的一致性与可信度 ③ 搭建线上质量监控体系 - 建立线上问题的自动分类框架:幻觉 / 知识盲区 / 上下文偏差 / 领域术语缺失 - 构建问题优先级模型:频率 × 业务风险 × 可修复性,驱动算法团队高效排期,避免"拍脑袋修 Bug" ④ 推动专家 Skill 的标准化上线 - 设计 Skill 质量评估标准与上线前的双重检核机制 - 建立 Skill 效果追踪:使用率、采纳率、相对通用模型的质量提升幅度 - 设计灰度发布与回滚机制,防止低质 Skill 污染整体系统

任职要求: - 3+ 年算法评测、NLP 测试或 AI 质量保障经验 - 熟悉行业开源 benchmark(如 HELM、LM-Eval、MMLU、AgentBench、SWE-Bench 等)的构建思路与适用边界,并对业务 Agent 场景下的 benchmark 设计有自己的深刻见解 - 扎实的数据分析能力——能用数据清晰表达"模型好在哪里、差在哪里、差多少" - 理解 RAG、Harness Engineering、Fine-tuning 的基本原理,能与算法工程师平等对话

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against li/referral's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on li/referral's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    li/referral's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.