Skip to content

Open nowPosted 53 days ago

Agent评测专家(ToB方向) - AI数据与安全

ByteDance19,204 open roles

Where
Beijing, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowAgent评测专家(ToB方向) - AI数据与安全ByteDance · Beijing, Chinese Mainland
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on ByteDance's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.3% of postings close within 7 days. Measured by our own scanner across the market. ByteDance postings stay open a median of 2 days.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.3%7 days
  4. 19.3%14 days
  5. 35.6%30 days
  6. 57.8%60 days
This job: posted 53 days ago

ByteDance median: 2 days open

The posting

团队介绍:AI 数据与安全团队为 Seed 基座模型及 AI 原生应用提供跨模态数据服务,覆盖数据生产全流程,包含模型评估标准的制定、数据规模化生产、数据飞轮搭建,不断提升数据质量,支持模型快速迭代。 团队由产品经理、数据工程、数据运营等跨职能人才组成,并通过与 Seed 研究员、行业专家、全球顶尖数据供应商紧密合作,从真实场景中收集反馈并分析模型表现数据,解决 AI 前沿突破过程中的复杂数据问题,推动模型性能与用户体验的双重提升。我们既是帮助模型技术迭代的一线贡献者,也是模型和 AI 产品的一手用户。

1、负责Agent、Coding等方向的模型评测项目,理解业务目标和模型能力边界,将抽象的能力诉求拆解为具体、可触发、可观测、可判定的评测问题及测试点,形成可执行的评测方案; 2、组织外部专家开展评测数据生产,根据不同评测方向定义专家画像和准入标准,完成专家筛选、试做、培训、校准、任务派发和质量验收,将专家的非标准知识转化为稳定、可规模化交付的评测资产; 3、推动自动评估链路工程化落地,使用Python等编程语言搭建和维护评估任务,将数据集、模型调用、Agent运行环境、Judge、评分逻辑及结果分析接入司内评估平台,确保评估流程可复现、可追踪、可扩展; 4、与算法研究员、产品、工程团队紧密协作,准确理解模型迭代需求,以评测数据和典型案例推动问题定位、能力改进及版本决策。

1、本科及以上学历,计算机科学与技术、人工智能、信息科学、大数据科学与技术、软件工程等相关专业优先; 2、熟悉大模型/Agent工作原理,能读懂Agent执行过程的完整轨迹;能拆解问题类型,并明确可判定的问题表现,可以总结出相对应的高发场景、触发条件和可观测信号; 3、能分析模型得分和负面案例分布,识别题目、Judge及评分标准问题,并针对性优化题目、样例和评判规则; 4、能将模型问题拆解为可观测、可触发、可判定的类型;熟悉Python等编程语言,具备评估链路工程化能力者优先; 5、具备良好的沟通和项目管理能力,能设计评测集生产协作链路,明确分工并完成产能、排期和风险管理; 6、善于发现流程卡点,能运用Python、自动化工具或轻量产品提升效率,推动生产流程可追踪、可度量。

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against ByteDance's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on ByteDance's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    ByteDance's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.