Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 34 days ago

AI 测试工程师

01ai/index54 open roles

Where
Beijing, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowAI 测试工程师01ai/index · Beijing, Chinese Mainland

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on 01ai/index's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

15.1% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 2.4%1 day
  2. 6.5%3 days
  3. 15.1%7 days
This job: posted 34 days ago

The posting

主要负责重点企业 Agent 项目的测试与评测交付，主导 B 端评测体系建设，并参与评测 Harness 和通用评测平台建设。既能在项目中动手解决问题，也能把经验沉淀为方法、工具和平台能力。

岗位职责 1、负责重点企业 Agent 项目的测试与评测交付 -作为领域主 R，制定测试策略、评测方案和验收标准； -理解客户业务和使用场景，识别关键质量风险； -推动产品、算法、研发和交付团队解决问题； -输出可用于上线、交付和客户验收的评测结论与改进建议。 -负责 AI/Agent 全链路测试与评测 -覆盖大模型应用、知识库检索、Agent、工具调用、多轮对话和工作流； -设计人工评测、自动评测和模型辅助评分相结合的评测方案； -处理结果波动、上下文干扰、工具选择错误等问题； -根据日志和调用链分析失败原因，推动问题修复和回归验证。 2、主导 B 端 Agent 评测体系建设 -建立质量指标、评测数据集和人工评测标准； -建设标准集、回归集、难题集及覆盖度评估机制； -建立评测基线、版本对比、上线门槛和线上问题回流机制； -沉淀可复用的领域评测方案、模板和最佳实践。 3、建设评测 Harness 和通用评测平台 -建设或完善 Harness，支持测试场景加载、批量执行、模型与 Agent 调用、结果收集、自动评分、版本对比和失败重跑； -从重点项目中抽象共性需求，参与数据集管理、任务编排、结果分析和报告生成等平台能力建设； -推动 Harness 与评测平台衔接，并在真实项目中落地使用； -支持不同模型、提示词、Agent 和工作流版本的对比评测。 5、负责关键质量专项和工具建设 -推进稳定性、性能、安全及对抗测试等专项； -开发测试与评测脚本、工具或平台组件，并应用到实际流程； -利用 AI 工具提升用例生成、数据标注、异常挖掘和失败分析效率。

1、5年以上测试、测试开发、质量或评测经验，2年以上 AI/Agent 评测经验；能独立负责复杂项目交付。 2、理解Harness，并有测试/评测Harness实践经验，能够完成执行、评分、结果汇总和回归对比。 3、熟悉 AI/Agent 评测方法，具备评测集建设、指标设计和人工与自动评测结合的经验。 4、了解知识库检索、Agent、工具调用、多轮对话和工作流，理解 AI 结果不稳定及其评测方法。 5、具备较强工程能力，掌握 Python，能够开发评测脚本、工具或平台组件。 6、有 B 端或企业级项目经验，理解数据隔离、权限管理、审计、发布回滚和私有化部署等质量要求。 7、具备体系化和平台化思维，能从项目中提炼通用需求，并推动跨团队落地。 8、有较强的主人翁意识和跨团队影响力，能够在没有管理权限的情况下推动结果。

加分项 1、有从 0 到 1 建设评测 Harness、评测平台或大型评测数据集的经验。 2、有 AI 安全、对抗测试、稳定性或性能专项治理经验。 3、熟悉主流评测框架、调用链分析工具或 AI 研发辅助工具。 4、有金融、政务、制造、零售、运营商、医疗等行业的企业 AI 项目经验

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against 01ai/index's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on 01ai/index's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    01ai/index's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.