Skip to content

Open nowPosted 46 hours ago

Data Center Hardware Operations Site Lead

Baseten108 open roles

Pay
$150,000 – $295,000 a year
Where
Santa Clara
Work mode
On site
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowData Center Hardware Operations Site LeadBaseten · Santa Clara
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Baseten's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

14.5% of postings close within 7 days. Measured by our own scanner across the market. Baseten postings stay open a median of 74 days.

Share of postings closed within
  1. 2.2%1 day
  2. 4.8%3 days
  3. 14.5%7 days
  4. 23.2%14 days
  5. 39.9%30 days
  6. 59.3%60 days
This job: posted 46 hours ago

Baseten median: 74 days open

The posting

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

As a Data Center Hardware Operations Site Lead at Baseten, you'll own the physical infrastructure behind our GPU fleet at one of our data center sites. You'll plan and lead the installation, cabling, and turn-up of new GPU clusters, keep existing clusters healthy through break/fix and upgrades, and decommission hardware when it's time. You'll work closely with our DC facilities, network, and hardware systems engineering teams across the full bare metal server lifecycle.

This is a senior, fully on-site role with a lot of ownership. You'll be the technical and project lead for your site and its first point of escalation when something goes wrong, whether that's a failed switch or a cooling alarm. You'll direct the day-to-day work of the FTE and contractor staff at your site, and partner with Site Leads at our other locations and our data center infrastructure lead to keep standards consistent across the fleet.

EXAMPLE INITIATIVES

The GPU clusters you deploy and maintain power work like this:

- Multi-cloud capacity management https://www.baseten.co/blog/how-baseten-multi-cloud-capacity-management-mcm-powers-cloud-self-hosted-and-hybr/

- Inference on B200 GPUs https://www.baseten.co/blog/accelerating-inference-nvidia-b200-gpus/

- Multi-node inference https://www.baseten.co/blog/how-multi-node-inference-works-llms-deepseek-r1/

- NVIDIA B300 vs. GB300 https://www.baseten.co/articles/nvidia-b300-vs-gb300/

RESPONSIBILITIES

- Lead the physical deployment of new GPU clusters at your site, including rack and stack, cabling, and turn-up in partnership with the network and hardware systems engineering teams.

- Plan white space for new and existing data halls with DC Facilities, including cabinet positions, fiber tray design, rack elevations, and the power, cooling, and network capacity needed for high-density GPU racks.

- Support new data hall bring-up through site walks, drawing review, and construction-to-operations turnover.

- Own break/fix and hardware lifecycle at your site, from diagnosing failures and coordinating RMAs to executing upgrades, switch refreshes, and decommissioning with minimal disruption to production.

- Work with the network team to test and turn up new cross connects and remediate links that are taking errors.

- Act as the site's first point of escalation for facility issues such as power, cooling, or leak alarms, working with DC Facilities to assess impact on hardware and coordinate a response.

- Write, review, and execute MOPs and SOPs for hardware work at your site, and run regular inspections and audits of installed equipment.

- Manage and schedule FTE and contractor labor at your site, including low voltage cabling vendors deploying structured cabling.

- Own logistics and inventory at your site, including receiving, spares management, and keeping DCIM asset location data accurate.

- Define and maintain site standards and safety practices with peer Site Leads and the data center infrastructure lead, and mentor HW Ops team members at your site.

REQUIREMENTS

- Bachelor's degree in a technical field or equivalent practical experience.

- 6+ years of experience in data center operations, with at least 2 years in a lead or supervisory role.

- Hands-on experience racking, stacking, and cabling servers and network gear at scale, including copper and fiber.

- Experience across the full bare metal server lifecycle: installation, break/fix, upgrades, and decommissioning.

- Comfort on the Linux command line for hardware diagnostics, using tools like ipmitool, dmesg, and lspci.

- Working knowledge of data center networking, enough to troubleshoot optics, transceivers, and link errors.

- Working knowledge of data center mechanical and electrical systems, including power distribution (UPS, PDUs, RPPs, busway), cooling (CRAH/CRAC units, containment, liquid cooling), and BMS/EPMS alarms, enough to recognize issues and escalate them with clear technical context.

- A track record of leading data center projects end to end, such as cluster deployments or data hall builds.

- Experience directing contractors and vendors and coordinating work across facilities, network, and engineering teams.

- Sound judgment and quick prioritization under pressure, including knowing when to escalate.

- Ability to work on-site at the data center in Santa Clara, CA or Westlake, TX, lift up to 50 lbs, work in elevated locations, and participate in an on-call rotation supporting 24/7 operations.

NICE TO HAVE

- Experience deploying and maintaining large NVIDIA GPU clusters (HGX/DGX platforms such as H100, H200, or B200).

- Hands-on experience with direct liquid cooling, including CDUs, rear door heat exchangers, and leak response.

- Construction and commissioning experience, such as reviewing submittals or witnessing tests for new data halls.

- Experience with high-performance interconnects such as InfiniBand or RoCE.

- Experience with Cisco IOS, Juniper Junos, or similar network operating systems.

- Experience with DCIM tools such as NetBox.

- Scripting in Python or Bash to automate diagnostics or inventory tasks.

- Certifications such as CompTIA Server+ or Network+.

- Prior experience standing up a new site from scratch.

BENEFITS

- Competitive compensation, including meaningful equity

- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents

- Flexible PTO policy

- Paid parental leave

- Fertility and family-building stipend through Carrot

- (U.S. only) Company-facilitated 401(k)

- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Baseten's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Baseten's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Baseten's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.