Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 43 days ago

大模型自动评测运营（文娱方向） - AI数据与安全

ByteDance19,258 open roles

Where
Beijing, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen now大模型自动评测运营（文娱方向） - AI数据与安全ByteDance · Beijing, Chinese Mainland

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on ByteDance's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

11.3% of postings close within 7 days. Measured by our own scanner across the market. ByteDance postings stay open a median of 23 days.

Share of postings closed within
  1. 2.0%1 day
  2. 4.3%3 days
  3. 11.3%7 days
  4. 17.6%14 days
  5. 34.3%30 days
  6. 43.5%60 days
This job: posted 43 days ago

ByteDance median: 23 days open

The posting

团队介绍：AI 数据与安全团队为 Seed 基座模型及 AI 原生应用提供跨模态数据服务，覆盖数据生产全流程，包含模型评估标准的制定、数据规模化生产、数据飞轮搭建，不断提升数据质量，支持模型快速迭代。 团队由产品经理、数据工程、数据运营等跨职能人才组成，并通过与 Seed 研究员、行业专家、全球顶尖数据供应商紧密合作，从真实场景中收集反馈并分析模型表现数据，解决 AI 前沿突破过程中的复杂数据问题，推动模型性能与用户体验的双重提升。我们既是帮助模型技术迭代的一线贡献者，也是模型和 AI 产品的一手用户。

1、围绕角色扮演、剧情演绎等娱乐AI核心场景，搭建可复用的自动化评估工作流，优化评估题库与流程，打通自动评估、人工评估与线上模型迭代的衔接； 2、建设评测数据资产：从产品真实对话与人工标注中挖掘具有区分度的评测样本与负面案例，构建并维护评测集、回归集与边界案例库，设计人工评估规范与打分标准，校准自动评估结果与人类判断的一致性； 3、搭建评估结果自动分析与推送机制：自动分析评估数据、生成多维度评估报告，定期定向推送重点结论与典型负面案例，为模型优化与产品迭代提供依据。

1、2027届获得本科及以上学历，计算机、软件工程、统计、人工智能等理工科背景，以及心理学、汉语言、传媒等跨学科背景； 2、具备技术实践能力，均欢迎投递；具备良好的代码能力，能独立编写脚本处理数据、调用大模型API、搭建评估Pipeline；熟悉SQL数据查询与聚合； 3、熟悉SFT/RM/RLHF等大模型训练范式，理解各阶段的评估方法与常用指标； 4、具备Prompt Engineering能力，能独立设计Prompt策略与工作流； 5、做事靠谱，有较强的自驱力和学习能力，能在模糊需求下拆解问题并推进落地。

加分项 1、对AI陪伴类产品有热情（如猫箱、星野、Character.AI等），对AI对话内容质量有敏锐感知； 2、熟悉二次元、乙女游戏、网文、剧本杀等文娱内容，能够判断角色塑造与剧情节奏的优劣； 3、有自动化评测相关实习或项目经验，了解LLM-as-Judge等自动评估方法及其局限。

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against ByteDance's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on ByteDance's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    ByteDance's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.