Lead Machine Learning Operations Engineer

Other Jobs To Apply

Job Description:

  • Own ML production reliability strategy
  • Define and lead the operational strategy for production ML systems, including monitoring, traceability, deployment safety, incident response, and post-deployment validation.
  • Set the standards ML teams use to assess model health, performance, and trustworthiness in production.
  • Own model traceability and governance
  • Ensure every production model has clear lineage (data, features, code, artifacts, validation, deployment history) and drive adoption of model registry and metadata tooling across ML teams.
  • Build end-to-end ML observability
  • Design and implement monitoring across the full ML signal path: data arrival, feature freshness, distribution stability, candidate generation, ranking behavior, model metrics, serving latency, and SLA performance.
  • Define production health metrics
  • Partner with ML, data, product, and business stakeholders to define post-deployment metrics covering model quality, system reliability, business guardrails, and degradation indicators.
  • Detect drift and degradation proactively
  • Detect data drift, feature drift, model behavior changes, and silent failures before they impact customers via thresholding, alerting, anomaly detection, and release-over-release monitoring.
  • Lead diagnostic tooling and root-cause analysis
  • Build dashboards, logs, and diagnostic workflows that progress quickly from “recommendations look off” to root cause, with context captured across candidates, features, scores, ranking decisions, and downstream outcomes.
  • Own ML deployment safety
  • Define and operate automated gates that prevent bad models or bad data from being promoted to production.
  • Partner with MLEs to establish validation checks, rollback criteria, canary strategies, shadow testing, and release health reviews.
  • Lead ML incident response
  • Own incident response practices for ML systems, including rollback playbooks, hotfix strategies, severity definitions, tradeoff frameworks, communications, and post-mortems.
  • Drive closure of systemic gaps after incidents rather than only resolving the immediate issue.
  • Partner across ML Platform, Data, and ML
  • Partner with DevOps/Platform on infrastructure and observability needs; with Data Engineering on data quality, drift, and freshness; and with ML Engineering to embed operational requirements into development and deployment workflows.
  • Set standards and mentor others
  • Act as the technical lead for ML operations: establish reusable patterns, playbooks, and standards, and mentor engineers on reliability, observability, and operational rigor.

Requirements:

  • 5+ years of experience in machine learning engineering, ML platform, applied ML, MLOps, data platform, reliability engineering, or a related technical role.
  • Demonstrated experience operating production ML systems, including monitoring, deployment, incident response, model validation, data quality, or reliability ownership.
  • Experience leading technical initiatives across multiple engineering teams, especially where success required influencing architecture, tooling, standards, or adoption.
  • Hands-on experience with model registries, feature stores, ML metadata systems, production monitoring, model deployment pipelines, or ML observability platforms.
  • Solid knowledge of end-to-end ML systems, including training data, features, model artifacts, offline validation, online serving, post-deployment metrics, and business outcome measurement.
  • Ability to reason about ML operational failure modes: stale features, distribution shift, training-serving skew, delayed labels, and offline-online metric gaps.
  • Solid SQL skills and comfort investigating data quality, feature distributions, model outputs, pipeline behavior, and production anomalies.
  • Track record of cross-functional collaboration with Platform, Data, and ML Engineering to deliver production-grade operational capabilities.
  • Solid written and verbal communication skills, including the ability to explain ML system health, risks, incidents, and tradeoffs to both technical and non-technical stakeholders.

Benefits:

  • medical
  • dental
  • vision
  • 401(k) plan
  • life insurance coverage
  • disability benefits
  • tuition assistance program
  • PTO
Back to blog

Other Jobs To Apply

Field Care Management Behavioral Health - Field/Remote LA

[Remote] Account Manager, Client Services - Channel Partners, OI Product - Remote

Sr. Customer Success Manager, Health Systems (Remote with Regional Travel)

Financial Assistance Program CSSR III- Remote

Corporate Affairs Director, Artificial Intelligence and Data (Remote)

[Remote] Senior IT Architect, Veeva Domain

Area Prevention Specialist, HIV Prevention

Clinical Research Associate (M/W/D) - Region: Stuttgart, Heilbronn, Heidelberg

Capture Manager, ATAC

amazon warehouse associate $15+/ Hour (Sign on Bonus)!

Senior Project Engineer - Power Generation - Malaysia

Account Manager, OEM

Engineering Project Manager - Remote Operation Center Projects

Inside Sales Representative II - REMOTE

Collision Performance Manager, East Coast

Sales Representative - Midwest Region

Remote Account Manager – Healthcare Packaging (Tyvek)

Sr. Electrical Engineer

Generated Gas Site Supervisor

Manager, Remote Sales Support

Data Engineer- Senior Software Engineer – Data, Analytics and AI

Network Engineer-Remote (Orlando)

Senior Data Analyst - Layla AI

TurboTax (WFH) Customer Service - Entry-Level

Remote Virtual Bookkeeper.

TurboTax Product Expert (Work From Home)

Senior Program Manager – Finance Transformation & Strategic Programs (Night Shift)

Wix Web Designers Needed at Awesome Growing Agency

Principal Software Engineer

Enterprise Account Executive, Remote US

Remote Partner Solutions Engineer

Lead Datadog Developer-Remote

Principal Sales Engineer, SLED (Remote)

Threat Hunter, FedCloud (Remote)

Digital Sales Representative 2

DocuSign Specialist

Senior Privacy Engineer

Solutions Engineering, Enterprise Emerging Markets

HubSpot Implementation Specialist

Community Manager, Slack

AWS Databricks Engineer- Remote-6 Months - Must be authorized to work in the U.S. without sponsorship.

Snowflake Architect - Remote

Deployment Specialist - Palantir

[Remote] Staff Software Engineer, Frontend (Consumer - Advanced Trading)

Engineering Manager

Remote eBay Expert

Shopify Expert (Remote)

Senior Growth Account Executive

Solutions Consultant

Facilitator SNAP

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...