Senior ML Ops Engineer

Franklin Fitch
Boston, MA

Senior ML Ops Engineer | High-Growth AI Startup | $190,000 - $210,000 | Boston (Hybrid)


A venture-backed AI startup is expanding its engineering team and hiring a Senior MLOps Engineer to build and scale production-grade AI systems for healthcare automation.


This role is focused on building secure, scalable AI infrastructure that supports real enterprise deployment.


Responsibilities:

  • Deploy NLP, OCR, and multimodal AI models in secure cloud environments
  • Design scalable ML pipelines with strong observability, reliability, and performance
  • Build data schemas and ETL workflows for annotations, training, tuning, and benchmarking
  • Establish best practices in experiment tracking, model versioning, and reproducibility
  • Write high-quality, maintainable production code
  • Build internal AI tools to support engineering and product teams
  • Identify and mitigate technical risks early in the release cycle


Requirements:

  • 8–10+ years total engineering experience
  • 4+ years in MLOps, SRE, DevOps, ML Platform, or similar
  • Strong background in AI data modeling, versioning, and annotation workflows
  • Recent experience delivering scalable enterprise AI products
  • Familiarity with MLflow, LangChain, LangFuse, W&B, CrewAI, or similar frameworks
  • Understanding of monitoring, experiment comparison, and evaluation frameworks
  • Experience with multiple database technologies
  • Strong communication skills and comfort in cross-functional environments
  • Preference for candidates with a mix of startup and tech-company experience
  • Heavy big-bank or Fortune 500 backgrounds are less aligned


Why This Role:

  • High-impact AI work in a complex, meaningful domain
  • Early-stage ownership with influence over AI architecture and engineering culture
  • Competitive compensation, equity, benefits, and flexible time off
  • Flat structure and direct access to leadership


Location: Boston area (hybrid). Local candidates preferred.

// // //