Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 113 days ago

大模型评测工程师-Data（北京/上海）

ByteDance19,268 open roles

Where
Beijing, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen now大模型评测工程师-Data（北京/上海）ByteDance · Beijing, Chinese Mainland

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on ByteDance's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

11.9% of postings close within 7 days. Measured by our own scanner across the market. ByteDance postings stay open a median of 9 days.

Share of postings closed within
  1. 2.1%1 day
  2. 4.4%3 days
  3. 11.9%7 days
  4. 18.6%14 days
  5. 35.6%30 days
  6. 45.1%60 days
This job: posted 113 days ago

ByteDance median: 9 days open

The posting

1、负责大模型评测体系建设：负责将业界SOTA大模型（含多模态大模型）部署到内部评测环境，基于多领域评测集完成规模化跑测，验证并校准模型评估指标，保障评测流程的准确性与可复现性； 2、开源评测集适配与集成：调研并引入业界主流开源评测集（覆盖文本、多模态与Agent三类，以多模态与Agent评测为主），将其适配、接入到内部模型评测体系，统一评测指标口径与执行流程，保障评测的覆盖度、针对性与可复现性； 3、Agent能力评测：针对Agent Based Bench开展评测，支持多轮交互、工具调用、Sandbox环境与轨迹记录，分析任务完成情况与失败原因，评估模型的Agent能力边界； 4、评测结果自动化分析：设计算法与工具，实现评测结果的自动化量化分析、异常定位及根因追溯，输出结构化分析报告，为模型选型与迭代提供数据支撑； 5、Agent RL环境与推理优化（可成长方向）：探索面向一般性Agent RL的Environments Scaling Up，构建可扩展的交互式环境（Environments）、无偏奖励信号（Unbiased Reward Signal）与评估（Evaluation）；并参与模型推理性能优化探索（如量化、KV Cache优化、批处理调度等）；以上均为探索方向，提供相应技术支持与成长空间。

1、本科及以上学历，计算机科学、人工智能、数学、统计学等相关专业； 2、扎实掌握机器学习、深度学习核心理论，熟悉大模型底层原理，了解常见大模型(含多模态大模型)的特性与主流评测方法； 3、具备扎实的编程能力，熟悉PyTorch等深度学习框架，能独立完成算法实现与调试；熟悉大模型部署与推理流程； 4、熟悉多模态大模型评测技术，有图文等跨模态评测经验；了解Agent评测(多轮交互、工具调用等)的基本方法； 5、具备良好的逻辑思维、问题解决能力与沟通协作意识，能清晰表达技术思路，高效推进跨团队协作，具备一定的文档撰写能力。

加分项 1、熟悉主流开源评测Benchmark与Agent Based Bench(如BFCL、BrowseComp等),有评测集接入或自动化评测工具开发经验者优先； 2、有大模型推理优化经验，熟悉vLLM、SGLang、TensorRT-LLM等推理框架，或有量化、并行推理、算子优化、Agent RL环境构建相关实践者优先。

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against ByteDance's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on ByteDance's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    ByteDance's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.