Skip to content

Open nowPosted 11 hours ago

Engineering Manager, Production Platform and Orchestration

Jobgether4,035 open roles

Where
US
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowEngineering Manager, Production Platform and OrchestrationJobgether · US
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Jobgether's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

8.1% of postings close within 7 days. Measured by our own scanner across the market. Jobgether postings stay open a median of 6 days.

Share of postings closed within
  1. 1.8%1 day
  2. 3.5%3 days
  3. 8.1%7 days
  4. 15.1%14 days
  5. 33.9%30 days
This job: posted 11 hours ago

Jobgether median: 6 days open

The posting

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Engineering Manager, Production Platform and Orchestration based in the United States.

This is a high-impact technical leadership role responsible for building the production foundation behind a rapidly scaling AI inference platform. You will lead the engineering organization responsible for provisioning, deploying, observing, upgrading, and reliably operating production systems. The role combines people leadership, systems architecture, operational excellence, and strategic roadmap ownership. You will shape the orchestration, reliability, automation, and control-plane capabilities required to support a growing and increasingly heterogeneous accelerator fleet. Working across software, hardware, data center, serving, model, and customer-facing teams, you will turn complex operational needs into durable engineering solutions. You will also establish clear ownership, measurable reliability standards, and scalable operating practices that reduce manual effort as the fleet expands. This is an opportunity to influence both the technology and organizational foundations of a next-generation AI infrastructure environment.

Accountabilities

  • Lead, coach, and grow a distributed engineering team focused on production platforms, fleet orchestration, reliability, and operational automation.
  • Establish clear ownership boundaries, develop emerging technical leaders, recruit effectively, and create an organization capable of scaling with the infrastructure footprint.
  • Translate customer and business priorities into a coherent engineering roadmap while protecting the team from reactive or unstructured operational demands.
  • Define the technical strategy for provisioning, deployment, environment lifecycle, fleet health, capacity, upgrades, rollback, and production control-plane capabilities.
  • Build reliable orchestration systems covering inventory, placement, configuration, health management, and multi-system operations across a heterogeneous accelerator environment.
  • Establish service-level objectives, operational metrics, alerting standards, and sustainable on-call practices for customer-facing production systems.
  • Own the operating cadence for incidents, escalations, postmortems, corrective actions, launch readiness, and reliability reviews.
  • Drive automation across deployment, upgrades, remediation, diagnostics, capacity planning, and common support workflows to prevent fleet growth from creating proportional operational overhead.
  • Partner with hardware and data center teams on rack bring-up, networking, firmware, sparing, failure handling, and infrastructure transitions.
  • Collaborate with serving/API, model enablement, and compiler/runtime teams to turn new platform capabilities into reliable, supportable production services.
  • Monitor fleet health, incident patterns, deployment reliability, operational toil, and critical failure points, using these insights to prioritize platform investments.
  • Establish durable operating practices and specialized ownership as the production organization grows across fleet orchestration, deployment lifecycle, observability, data center operations, and operational tooling.
  • Demonstrated success managing and growing engineering teams responsible for distributed systems, cloud infrastructure, production platforms, SRE, or closely related technical domains.
  • Strong technical judgment across Linux systems, networking, orchestration, deployment systems, observability, and production reliability.
  • Proven ability to turn ambiguous operational challenges into clear roadmaps, explicit ownership models, and measurable engineering outcomes.
  • Experience recruiting, coaching, developing, and retaining engineers across experience levels while maintaining a high technical bar.
  • Ability to operate effectively across software, hardware, data center, customer, and business boundaries.
  • Excellent written and verbal communication skills, including the ability to make technical tradeoffs, priorities, risks, and decisions clear to both technical and executive stakeholders.
  • Hands-on leadership style with sufficient technical and operational depth to engage in architecture and production discussions without becoming a bottleneck.
  • Experience operating services with meaningful availability expectations, including on-call programs, incident management, root-cause analysis, and reliability planning.
  • Experience with control planes, schedulers, placement systems, capacity-management systems, or multi-rack orchestration is highly valuable.
  • Experience working with GPU, FPGA, ASIC, or other accelerator fleets in production is strongly preferred.
  • Background in data center deployment, hardware lifecycle management, firmware coordination, sparing/RMA processes, or production networking is advantageous.
  • Demonstrated ability to scale infrastructure from early deployments to multiple sites or hundreds of systems.
  • Experience with customer-facing infrastructure where engineering teams participate in production escalation and service readiness.
  • Proven automation experience that has materially reduced operational toil, incident frequency, recovery time, or manual intervention.
  • Ability to develop a sustainable production organization with clear specialties, healthy management spans, and scalable operational coverage.
  • Base salary range of $200,000–$300,000, with flexibility based on experience, specialized expertise, qualifications, internal equity, and expected impact.
  • Competitive equity as part of the overall compensation package.
  • Fully company-paid medical, dental, and vision insurance for employees and dependents.
  • Company-paid life and disability insurance, with additional voluntary coverage options.
  • Supplemental hospital, critical illness, and accident insurance options.
  • Unlimited paid time off designed to support meaningful rest and flexibility.
  • 13 paid company holidays.
  • Remote-first work culture with a company-provided computer and home-office setup.
  • 401(k) plan with company matching, eligible from day one.
  • Opportunity to shape both the technology and organizational foundations of a rapidly growing AI infrastructure environment.
  • Visa transfer support for eligible H-1B candidates; new visa sponsorship is not available for this role.
  • Position is remote within the United States and requires current authorization to work in the U.S.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Jobgether's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Jobgether's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Jobgether's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.