Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowFirst seen 4 hours ago

QA Engineering Lead (AI)

Meta1,337 open roles

Pay
$163,000 – $224,000 a year
Where
Menlo Park, CA
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowQA Engineering Lead (AI)Meta · Menlo Park, CA

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Meta's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

13.5% of postings close within 7 days. Measured by our own scanner across the market. Meta postings stay open a median of 35 days.

Share of postings closed within
  1. 2.3%1 day
  2. 4.6%3 days
  3. 13.5%7 days
  4. 21.8%14 days
  5. 36.6%30 days
  6. 58.9%60 days
This job: first seen 4 hours ago

Meta median: 35 days open

The posting

We’re looking for QA Engineering Leads to set technical direction and lead major quality initiatives for our GenAI products at Meta. You enjoy solving difficult, ambiguous quality problems and building evaluation systems that enable multiple teams to ship reliable AI experiences. In this hands-on role, you will shape quality strategy across related products and platforms, lead the design and implementation of shared testing and evaluation capabilities, and help other engineers deliver high-quality work.

Responsibilities

  • Define and drive the technical quality strategy and roadmap for a major Gen AI initiative spanning multiple engineering teams, balancing product risk, delivery speed, and engineering investment
  • Lead and perform hands-on testing of consumer-facing and business-facing applications, APIs, and AI models, adapting quality priorities and test coverage in a fast-paced development environment
  • Architect and implement shared AI evaluation and test automation systems that support multiple models, products, and platforms, while directly solving the most challenging technical problems
  • Establish consistent evaluation methods, benchmark design, product-aligned weighted scoring frameworks, and quality standards for model behavior and end-to-end product experiences, working with research, engineering, and product partners
  • Lead the development of reliable evaluation signals, including calibration of human and automated judgments, analysis of measurement uncertainty, and investigation of gaps between offline evaluations and real-world outcomes
  • Identify systemic quality risks across models, data, applications, and infrastructure, and lead cross-team efforts to address their root causes
  • Drive quality planning for major launches and phased rollouts, aligning teams on success criteria, dependencies, monitoring, and regression response
  • Define metrics that connect model performance, product reliability, and user experience, and use them to guide quality priorities and investment decisions
  • Lead adoption of reusable evaluation frameworks, automation, and development practices that improve quality while reducing testing costs and time to feedback
  • Partner with engineering, infrastructure, research, product, and data teams to resolve technical trade-offs and influence product and system designs before quality issues emerge
  • Mentor QA engineers and technical leads, provide guidance, and raise the quality of engineering across the broader team

Minimum Qualifications

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Currently has, or is in the process of obtaining, a Bachelor’s degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience. A degree must be completed prior to joining Meta
  • 10+ years of quality assurance, test engineering, or software engineering experience, including substantial experience in building quality engineering systems
  • 3+ years of experience in AI model testing or evaluation, including designing evaluation frameworks and establishing model quality standards
  • Experience successfully leading a major technical quality initiative across multiple teams, from problem definition and architectural design through implementation, rollout, and measurable outcomes
  • Experience architecting and implementing scalable testing, automation, or evaluation systems in Python, PHP, Java, C/C++, or an equivalent programming language
  • Experience solving complex quality and reliability problems across client applications, backend services, and distributed systems
  • Hands-on experience testing consumer-facing and business-facing applications and APIs, and evaluating AI models
  • Hands-on experience with risk-based test strategy, performance and stress testing, and the design and maintenance of client and server test automation
  • Experience evaluating the reliability and limitations of quality metrics and using data to guide technical decisions
  • Experience leading quality engineering in fast-paced development teams, adapting test strategies and priorities as requirements evolve
  • Experience setting technical direction, resolving ambiguous requirements and cross-team dependencies, and influencing stakeholders without direct authority
  • Experience communicating complex technical problems, quality risks, and investment trade-offs to technical and non-technical stakeholders
  • Experience mentoring engineers or technical leads and driving the adoption of quality engineering practices beyond a single project

Preferred Qualifications

  • Experience leading the evaluation strategy for generative text, image, voice, or multimodal products at scale
  • Experience designing shared evaluation infrastructure or testing frameworks and leading their adoption across multiple engineering teams
  • Experience designing evaluation systems that combine human review, model-based judgments, adversarial testing, and automated regression detection
  • Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
  • Demonstrated improvements in product reliability, evaluation coverage, regression prevention, or engineering efficiency across a major product initiative
  • Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
  • Experience leading cross-platform quality efforts within large engineering organizations and building consensus on technical standards and priorities
  • Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
  • Experience applying frontier AI model evaluation practices, including weighted scoring frameworks for assessing model quality and performance
  • Experience with statistical evaluation methods, benchmark validity, evaluator calibration, and connecting offline evaluation results to production quality
  • Experience partnering with AI research teams and translating evolving research capabilities into scalable product quality practices

US: $163,000/year to $224,000/year + bonus + equity

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Meta's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on Meta's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    Meta's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.