Skip to content

Open nowPosted 4 days ago

AI Agent评估运营专家(智能助手方向) - AI数据与安全

ByteDance19,210 open roles

Where
Beijing, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowAI Agent评估运营专家(智能助手方向) - AI数据与安全ByteDance · Beijing, Chinese Mainland
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on ByteDance's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.1% of postings close within 7 days. Measured by our own scanner across the market. ByteDance postings stay open a median of 2 days.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.1%7 days
  4. 19.1%14 days
  5. 35.6%30 days
  6. 52.7%60 days
This job: posted 4 days ago

ByteDance median: 2 days open

The posting

团队介绍:AI 数据与安全团队为 Seed 基座模型及 AI 原生应用提供跨模态数据服务,覆盖数据生产全流程,包含模型评估标准的制定、数据规模化生产、数据飞轮搭建,不断提升数据质量,支持模型快速迭代。 团队由产品经理、数据工程、数据运营等跨职能人才组成,并通过与 Seed 研究员、行业专家、全球顶尖数据供应商紧密合作,从真实场景中收集反馈并分析模型表现数据,解决 AI 前沿突破过程中的复杂数据问题,推动模型性能与用户体验的双重提升。我们既是帮助模型技术迭代的一线贡献者,也是模型和 AI 产品的一手用户。

1、Agent评测与项目交付:负责手机助手、个人AI Agent及智能硬件相关模型能力评测,独立承接评测需求,完成方案设计、评测执行、数据分析、问题归因及结论交付,保障评测结果的准确性、可比性与交付效率; 2、自动评测体系建设:围绕复杂任务、多轮交互、工具调用、指令遵循等核心能力,设计自动评测集、Rubric和分层评估标准,建立场景化、端到端的Agent评测体系,参与真机自动化、Sandbox环境构造及评测链路建设,提升自动评测效率和稳定性; 3、前沿场景评测探索:面向个人AI助理的记忆生产与消费、真实世界Context、主动服务、跨端任务和硬件Connector等场景,探索评测方法,验证模型能力及硬件融合带来的用户体验增益; 4、模型效果分析与闭环:负责重点模型版本对比、线上回流分析、负面案例挖掘与归因,识别模型能力瓶颈,协同产品研发团队推动问题修复和效果验证。

1、本科及以上学历,计算机、人工智能、软件工程等相关专业优先,具有1年及以上AI模型评估、Agent评测相关经验; 2、熟悉大语言模型及Agent基本原理,理解Function Calling、Tool Use、多轮交互、任务规划及工具执行等核心机制; 3、具备完整的模型评测项目经验,熟悉LLM-as-Judge/Agent-as-Judge,能够独立进行评测方案设计、评测集建设、评分标准制定、rubric合成、数据分析及结果交付; 4、能够使用Python、SQL等工具进行数据处理与分析,具备自动化评测脚本或评测工具开发能力; 5、具备较强的问题分析、跨团队沟通和项目推进能力,能够主动识别风险、推动问题解决,并对交付结果负责。

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against ByteDance's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on ByteDance's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    ByteDance's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.