Skip to content

Open nowPosted 4 days ago

Engineering Manager, ML Training Infrastructure

woven-by-toyota142 open roles

Where
Palo Alto, CA
Work mode
Hybrid
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowEngineering Manager, ML Training Infrastructurewoven-by-toyota · Palo Alto, CA
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on woven-by-toyota's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

7.8% of postings close within 7 days. Measured by our own scanner across the market.

Share of postings closed within
  1. 1.6%1 day
  2. 3.4%3 days
  3. 7.8%7 days
  4. 14.3%14 days
  5. 33.7%30 days
This job: posted 4 days ago

The posting

Woven by Toyota is enabling Toyota’s once-in-a-century transformation into a mobility company. Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current state of mobility through human-centric innovation — expanding what “mobility” means and how it serves society.

Our work centers on four pillars: AD/ADAS, our autonomous driving and advanced driver assist technologies; Arene, our software development platform for software-defined vehicles; Woven City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation. Business-critical functions empower these teams to execute, and together, we’re working toward one bold goal: a world with zero accidents and enhanced well-being for all.

About the Team

Enterprise AI is a platform that provides end-to-end machine learning tooling experience to support and accelerate machine learning development, including autonomous driving and other related projects. Our platform serves customers as a standardized machine learning platform within Woven by Toyota as the larger Toyota Group companies.

The Enterprise AI ML Training Infrastructure team builds and operates the infrastructure that enables engineers and researchers to train, evaluate, and iterate on machine learning models at scale. Our customers include teams working on AD/ADAS and Woven City, where large-scale machine learning workloads, simulation, and data processing are critical to developing the next generation of mobility technologies.

The team operates at the intersection of machine learning, distributed systems, cloud infrastructure, and developer platforms. Our systems include large-scale GPU compute environments, Kubernetes-based cluster infrastructure, and workflow and pipeline orchestration technologies such as Ray, Airflow, and Temporal.

We are looking for an Engineering Manager to lead a team to help shape the technical direction, engineering culture, and long-term evolution of our ML training infrastructure platform.

WHO ARE WE LOOKING FOR?

As the Engineering Manager, ML Training Infrastructure, you will lead the team responsible for building and operating the infrastructure that powers machine learning training workloads across Woven by Toyota.

You will combine engineering leadership with strong technical judgment. You will work closely with engineering, research, and product stakeholders to understand customer needs, translate them into scalable technical solutions, and ensure that our platform is reliable, efficient, secure, and easy to use.

This role is particularly suited to an engineering leader who enjoys working on complex infrastructure problems and is comfortable operating across Kubernetes, distributed systems, GPU infrastructure, cloud platforms, and machine learning workloads.

You will also play an important role in building a strong engineering culture, developing engineers, establishing effective engineering practices, and partnering with our customers to continuously improve the platform.

What You Will Enable

In this role, you will help build the infrastructure that enables teams across Woven by Toyota to train and operate increasingly large and sophisticated machine learning workloads.

Your work will directly support engineers and researchers working on AD/ADAS, Woven City, and other mobility initiatives by making compute resources easier to access, workloads more reliable, and ML development faster and more scalable.

You will have the opportunity to shape both the technical architecture of a critical ML infrastructure platform and the engineering culture of the team building it.

RESPONSIBILITIES

  • Lead engineers and foster a collaborative and innovative environment.
  • Manage and nurture a group of around 7–8 engineers, offering technical vision, mentorship, professional growth, and effective project delivery.
  • Establish and articulate the technical vision and future roadmap for machine learning training infrastructure.
  • Direct the architecture, construction, and operation of resilient systems supporting massive ML model training workloads.
  • Construct and maintain Kubernetes-driven compute clusters and container ecosystems tailored for machine learning workloads.
  • Oversee and optimize GPU fleets, addressing cluster scheduling, resource utilization, system stability, and cost performance.
  • Advance distributed model training capabilities and workload management leveraging frameworks like Ray and adjacent tools.
  • Enhance workflow orchestration platforms by deploying and supporting solutions such as Airflow, Temporal, and similar pipeline frameworks.
  • Elevate the system resilience, monitoring insights, elasticity, and operational productivity of our ML training stack.
  • Work closely alongside AD/ADAS, Woven City, and internal platform partners to gather feature requests and ship infrastructure solutions that accelerate development.
  • Partner with cross-functional engineering groups to specify platform interfaces, APIs, system architectures, and operational standards.
  • Translate high-level organizational objectives and user requirements into concrete, executable engineering milestones with product leads.
  • Institute rigorous software practices across implementation, code reviews, automated testing, continuous deployment, and live site management.
  • Engage in production support workflows, lead post-incident reviews, and champion system refinements based on operational findings.
  • Balance immediate client feature requests against long-term architectural stability, technical hygiene, and system maintainability.
  • Foster an inclusive, highly collaborative, and excellence-driven engineering culture throughout Woven by Toyota.

MINIMUM QUALIFICATIONS

  • 8+ years of experience in software engineering, with at least 2 years in a leadership role.
  • Proven track record mentoring and managing high-performing software or platform teams.
  • Demonstrated expertise in architecting, deploying, and maintaining large-scale mission-critical infrastructure.
  • Deep technical mastery of Kubernetes orchestration alongside containerized runtime systems.
  • Hands-on exposure to cloud platform architectures and highly resilient distributed systems.
  • Background engineering platform foundation layers designed for machine learning model development or data pipeline intensive workloads.
  • Practical understanding of massive GPU cluster management, hardware scheduling algorithms, and capacity efficiency tuning.
  • Operational background overseeing high-availability environments, leading post-incident reviews, and advancing monitoring capabilities.
  • Excellent interpersonal abilities to align technical roadmaps across diverse engineering partners and leadership stakeholders.

NICE TO HAVES

  • Experience working with Japanese customers or clients.
  • Experience with Golang development (especially for cloud services)
  • Experience in the automotive industry or knowledge of automotive software development (e.g., ASPICE, V-model).
  • Experience working in environments with a focus on security and safety.
  • English/Japanese bilingual ability

The base pay for this position ranges from $140,000 - $260,000 a year.

Your base salary is one part of your total compensation. We offer a base salary, short term and long term incentives, and a comprehensive benefits package. The total compensation offered to an employee will be dependent upon the individual's skills, experience, qualifications, location, and level.

WHAT WE OFFER

We are committed to creating a modern work environment that supports our employees and their loved ones. We offer many options of the best programs to allow you to do your most meaningful work and to help you shape the future of mobility.

・Excellent health, wellness, dental and vision coverage

・A rewarding 401k program

・Flexible vacation policy

・Family planning and care benefits

Our Commitment

・We are an equal opportunity employer and value diversity.

・Any information we receive from you will be used only in the hiring and onboarding process. Please see our privacy notice for more details.

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against woven-by-toyota's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on woven-by-toyota's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    woven-by-toyota's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.