Head of Engineering

ZRG Careers
Boston, MA

For decades, progress in complex computer systems relied solely on human ingenuity. We are changing that paradigm. We are building an AI-based systems engineer that augments human experts to design and optimize the next generation of AI infrastructure.


Our Platform is a multi-agent system that mimics the R&D process of top-tier engineers—reasoning, experimenting, and analyzing experimental data in depth to deliver results 10-100x faster than human experts. We are turning weeks of manual systems engineering into hours of automated, high-performance output. Based on a decade of award-winning research at a top-tier research institution, and backed by significant VC- and angel-backed funding, we are now scaling our engineering organization to meet the demands of the AI era.


About the Role

We are looking for a dynamic, highly technical, hands-on Head of Engineering to lead our small but exceptional team of engineers. This is a “player-coach” role for a leader who still loves to dive into the design, architecture, and code with the team, but is equally passionate about (i) driving accountability, (ii) building a high-performance, truth-seeking, can-do culture, and (iii) delivering tangible business results.


You will manage the development of our platform that optimizes demanding AI workloads. You will report to the co-founder and CEO, and also work closely with our other co-founder, playing a pivotal role in shaping the technical and organizational future.


Responsibilities

  • Lead & scale: Manage and grow a highly productive team of systems and AI engineers, fostering a culture of disciplined rigor without bureaucratic friction.
  • Drive execution: Ensure that research-led designs and experiments are implemented in a robust, production-faithful platform that handles complex processing pipelines and heterogeneous hardware infrastructure.
  • Engineering execution: Own and execute the engineering roadmap, working closely with the Product and Business leadership of the company.
  • Bridge the gap between research and platform: Our work spans the range from research on trustworthy agentic AI to scalable and reliable platform engineering.


Desired Expertise and Experience

  • Systems intuition: You have a deep understanding of the entire stack, from model code and serving frameworks (Triton, vLLM) to hardware-specific runtime configurations.
  • Robust agentic AI systems: You have experience with agentic AI and a strong desire to build these systems using software and systems engineering principles.
  • Leadership depth: Experience managing small, high-performance teams in a fast-paced startup or advanced R&D environment. You know how to drive a team toward milestones while maintaining high software and system quality.
  • Technical excellence:
  • Strong proficiency in Python and AI/ML frameworks (e.g., PyTorch).
  • Experience with one or more of cloud systems for AI workloads, GPU optimization, and performance engineering.
  • Experience with agentic AI systems.
  • Experience with heterogeneous hardware environments and AI/ML pipelines.
  • Mission-driven: You believe AI is the ultimate collaborator for discovering new ideas in AI-driven systems and are excited to contribute to this mission.


Why Join?

  • Strong pedigree: Work alongside a team of renowned experts in AI-driven systems, leading our engineering group.
  • Massive impact: Our technology has demonstrated the ability to achieve significant improvements in long-running engineering research and design tasks spanning performance engineering, model pipeline development, and cost optimization..
  • Robust financials: Our seed round closed recently; we’re backed by top-tier VC firms, as well as recognized industry luminaries. We have also been signing paid PoCs with marquee customers.
  • Solving hard problems: We are solving the fundamental bottlenecks of the AI revolution: performance, complexity, and cost.

// // //