Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 3 days ago

大模型系统评测工程师

vrfi1sk8a0/index201 open roles

Where
Beijing, Chinese Mainland
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen now大模型系统评测工程师vrfi1sk8a0/index · Beijing, Chinese Mainland

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on vrfi1sk8a0/index's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

12.3% of postings close within 7 days. Measured by our own scanner across the market. vrfi1sk8a0/index postings stay open a median of 1 days.

Share of postings closed within
  1. 2.1%1 day
  2. 4.5%3 days
  3. 12.3%7 days
  4. 19.3%14 days
  5. 35.6%30 days
  6. 57.8%60 days
This job: posted 3 days ago

vrfi1sk8a0/index median: 1 days open

The posting

1. 根据真实业务和研究问题搭建评测场景，还原任务链路、执行条件、输入输出和完成标准。 2. 实现和维护场景所需的环境、数据、工具、MCP 接口、harness、评估器和模型适配，并管理其版本与依赖。 3. 建设评测运行能力，支持任务编排、沙盒隔离、资源调度、超时控制、失败重试和批量运行。 4. 统一记录模型请求、运行参数、执行轨迹、工具调用、日志、指标、reward 和评测产物，支持回放与复现。 5. 建设统一的模型对照和榜单管理能力，保证不同模型、版本和工作流能够在明确的控制条件下比较。 6. 建立评测工程的稳定性和维护机制，支持回归检测、场景变更影响追踪和运行问题定位。

1. 具备扎实的编程基础，熟练使用 Python，掌握 Go、Java 或其他后端语言者优先。 2. 具备平台工程、工作流编排、自动化测试或大规模任务运行经验，能够独立开发和维护生产系统。 3. 熟悉 Linux、容器、网络和分布式系统，理解任务调度、资源隔离、失败恢复和可观测性。 4. 具备较强的问题定位能力，能够结合日志、指标、运行轨迹和错误样本排查评测链路问题。 5. 对大语言模型、Agent、工具调用和模型评测有基本理解，能够将场景定义转化为可执行实现。 6. 具备良好的工程质量意识、文档能力和跨团队协作能力。 加分项 - 参与过大语言模型、Agent 或代码智能体的 benchmark、自动评测或榜单系统建设； - 有 Harbor、SWE-bench、MCP、沙盒或其他评测编排框架的使用和建设经验； - 有模型服务适配、工具调用链路、运行轨迹采集或结果回放经验； - 有评测系统的版本治理、回归检测、稳定性建设或成本优化经验。

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against vrfi1sk8a0/index's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on vrfi1sk8a0/index's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    vrfi1sk8a0/index's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.