Skip to content

Open nowPosted 87 days ago

AI评测专家 - 飞书

ByteDance19,268 open roles

Where
Beijing, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowAI评测专家 - 飞书ByteDance · Beijing, Chinese Mainland
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on ByteDance's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

11.5% of postings close within 7 days. Measured by our own scanner across the market. ByteDance postings stay open a median of 9 days.

Share of postings closed within
  1. 2.0%1 day
  2. 4.3%3 days
  3. 11.5%7 days
  4. 18.1%14 days
  5. 35.6%30 days
  6. 44.6%60 days
This job: posted 87 days ago

ByteDance median: 9 days open

The posting

团队介绍:飞书是字节跳动旗下 AI 工作平台,面向人与agent协作,提供一站式协同办公、组织管理、业务提效工具和深入企业场景的 AI 能力,让 AI 真能用真落地。 从互联网、高科技、消费零售到制造、金融、医疗健康,各行各业先进企业都在飞书落地AI,与飞书共创行业最佳实践。先进团队,AI用飞书。

1、负责AI Agent的评测体系建设,制定覆盖基础能力、业务效果、工具调用、任务执行、稳定性、安全性和用户体验的评测标准,根据业务场景设计评测集、评分规则和验收门槛,建立从离线评测、自动化评测到线上效果监控的完整评测链路; 2、设计并维护高质量评测数据集,负责样本采集、清洗、标注、分层、去重及版本管理,保障数据代表性、覆盖度和区分度; 3、建设自动化评测能力,综合使用规则、代码、模型裁判和人工专家完成多维评分,并持续提升评测结果的准确性与一致性; 4、建立失败案例归因体系,对幻觉、误判、漏答、工具调用失败、执行中断和结果不稳定等问题持续聚类,推动Top问题专项治理; 5、探索用户反馈、线上行为和业务结果与离线评测之间的关联,持续提升评测指标对真实用户体验的解释能力,跟踪业界评测方法和前沿技术,沉淀AI评测规范、最佳实践和方法论,推动评测能力在不同业务场景中复用。

1、具备大模型评测、算法评测、数据分析、测试开发或AI产品质量相关经验,有自动化评测平台或评测流水线建设经验、复杂任务E2E评测、工具调用评测或Computer Use Agent评测经验优先; 2、熟悉大语言模型、AI Agent、RAG、工具调用、Prompt Engineering和模型推理的基本原理; 3、熟悉准确率、召回率、Pass@K、成对比较、评分量表、LLM-as-a-Judge和人工评测等常见评测方法; 4、具备数据分析和基础编程能力,能够使用Python、SQL等工具完成数据处理、评测实验和结果分析; 5、具备较强的结构化分析和报告能力,能够从大量失败样本中提炼共性问题并提出。

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against ByteDance's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on ByteDance's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    ByteDance's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.