Skip to content

Open nowPosted 21 hours ago

Senior Engineer, Machine Learning/AI Ops

Jobgether3,387 open roles

Where
US
Work mode
Remote
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowSenior Engineer, Machine Learning/AI OpsJobgether · US
  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Jobgether's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

9.8% of postings close within 7 days. Measured by our own scanner across the market. Jobgether postings stay open a median of 6 days.

Share of postings closed within
  1. 1.9%1 day
  2. 3.9%3 days
  3. 9.8%7 days
  4. 15.5%14 days
  5. 33.7%30 days
This job: posted 21 hours ago

Jobgether median: 6 days open

The posting

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior Engineer, Machine Learning/AI Ops based in the United States.

The Senior Engineer, Machine Learning/AI Ops will design, build, and operate the cloud infrastructure powering machine learning models, internal AI tools, and event-driven integrations. This role combines strong software engineering expertise with hands-on experience in AWS, machine learning operations, infrastructure automation, and production platform engineering. Working closely with Data Science, Data Engineering, Analytics, Product, and other engineering teams, the successful candidate will help transform experimental models into reliable, scalable production services. Key responsibilities include developing real-time inference APIs, managing data integration pipelines, strengthening system observability, and maintaining secure, auditable AI infrastructure. The role also supports the responsible operation of large language models and agentic systems while improving deployment practices, reliability, and incident response. This is an opportunity for an autonomous technical professional to influence platform engineering standards and help advance AI capabilities in a security-conscious, data-driven environment.

Accountabilities

  • Design, build, deploy, and operate AWS infrastructure and services supporting machine learning models, internal AI tools, and event-driven integrations.
  • Develop and maintain event-driven integrations and change data capture (CDC) pipelines between internal systems and third-party platforms, including Salesforce and Braze.
  • Design reliable and recoverable integration workflows that account for idempotency, event replay, schema evolution, out-of-order events, and failure handling.
  • Build, deploy, and maintain containerized inference APIs and backend services with secure, versioned interfaces and production-grade performance.
  • Manage infrastructure as code using Terraform across multiple AWS accounts and environments, leveraging reusable modules and CI-gated workflows.
  • Develop and maintain machine learning workflows for training, retraining, scoring, batch processing, and real-time inference.
  • Partner with Data Science teams to establish repeatable processes for moving models from experimentation into production.
  • Implement observability across machine learning platforms, AI tools, and integration services, including logging, metrics, alerting, and model monitoring.
  • Support the secure operation of internal large language model (LLM) and agentic systems, including solutions built with Amazon Bedrock, through appropriate access controls, auditing, and data protection measures.
  • Collaborate with Data Engineering teams on Snowflake datasets, data access, and governance requirements supporting machine learning and operational workloads.
  • Operate and maintain PostgreSQL-backed production services, ensuring reliable schema migrations, effective indexing, and data correctness under concurrent writes.
  • Lead incident response activities, participate in on-call rotations, and develop runbooks and reusable engineering patterns that improve operational readiness.
  • Establish and promote platform engineering standards, safe deployment practices, and continuous improvement across production systems.
  • Work cross-functionally to identify technical risks, resolve integration challenges, and maintain reliable, secure, and scalable AI infrastructure.
  • At least six years of experience in MLOps, platform engineering, DevOps, site reliability engineering (SRE), backend engineering, or a related discipline, including substantial experience supporting production machine learning, data, or event-driven workloads.
  • A bachelor's degree in a relevant technical field.
  • Deep, hands-on experience designing and operating production workloads on AWS, including compute, messaging, infrastructure, and security services.
  • Strong professional Python programming skills, with experience building and operating production APIs, backend services, and integrations.
  • Demonstrated experience building event-driven integrations with third-party APIs, including change data capture pipelines.
  • Strong Terraform and infrastructure-as-code expertise across multiple production environments.
  • Practical experience deploying and operating machine learning models, including batch and real-time serving, model versioning, and monitoring.
  • Experience with containerization, CI/CD pipelines, and safe, reliable production deployment practices.
  • Hands-on experience operating PostgreSQL in production, including schema migrations, indexing strategies, and maintaining data integrity under concurrent writes.
  • Strong understanding of production system reliability, security, observability, troubleshooting, and operational support.
  • The ability to work independently, take ownership of outcomes, and make sound technical decisions without relying on prescriptive instructions.
  • Excellent communication and collaboration skills, with the ability to influence engineering standards and work effectively across technical disciplines.
  • Strong organizational and analytical skills, including the ability to manage multiple projects, reprioritize quickly, and deliver high-quality results in a fast-paced environment.
  • Preferred: Experience operating or securing internal LLM-based applications and agentic systems.
  • Preferred: Familiarity with machine learning observability, experiment tracking, or model drift detection tools.
  • Preferred: Hands-on experience with Snowflake supporting machine learning or production data workloads.
  • Preferred: Experience in financial services, fintech, or another regulated industry.
  • Availability for a regular full-time position, with the ability to participate in on-call support as required.
  • Annual salary: $150,500–$173,000 USD, with individual compensation determined by location, relevant skills, experience, education, and training.
  • Work arrangement: Remote position within the United States.
  • Healthcare coverage: Medical, dental, and vision benefits.
  • Retirement savings: 401(k) plan with employer matching.
  • Paid leave: Paid holidays, vacation, sick days, and volunteer time off.
  • Parental leave: 12 weeks of paid parental leave.
  • Insurance: Life insurance at no cost to employees, along with additional voluntary benefits.
  • Transportation: Pre-tax transit benefits.
  • Pet care: Discounted ASPCA pet health insurance.
  • Wellness: Employee wellness incentive program.
  • Career development: Mentorship and leadership programs, with opportunities for professional growth.
  • Work environment: A collaborative, team-oriented culture focused on employee development and continuous improvement.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Jobgether's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.
  3. We apply on Jobgether's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.
  4. Every reply, sorted

    Jobgether's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.
  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

By hand5–10
With CV Rocket100
applications a day

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.