Software Engineer - C++ / GPU Virtualization / Cloud Infrastructure

USA Tech Recruit
San Francisco, CA

Software Engineer - C++ / GPU Virtualization / Cloud Infrastructure


We are partnered with a high-growth infrastructure startup that is rethinking how the world accesses GPU compute making breakthrough strides in the GPU virtualization stack. The team are looking for an experienced Software Engineer to work on some of the hardest problems surrounding GPU clusters.


This is a permanent onsite position in San Francisco.


Key Responsibilities

  • Own the performance optimization of the core C++ virtualization library, squeezing every microsecond out of the stack.
  • Drive R&D into complex problems like GPU oversubscription, checkpointing, and distributed cluster orchestration.
  • Implement support for next-generation GPU architectures, requiring a deep understanding of the entire system from driver to user-space.
  • Tackle high-stakes systems-level debugging and root-cause analysis in live production environments.
  • Identify and resolve performance bottlenecks specifically within large-scale Machine Learning and LLM training workloads.


Key Requirements:

  • Exceptional skills in modern C++ (Systems level) with a focus on memory management, concurrency, and low-latency execution.
  • A strong grasp of GPU computing (CUDA/ROCm), drivers, or virtualization technologies.
  • Comfortable working close to the metal, including knowledge of PCIe, NVLink, or InfiniBand.
  • A background working in Trading Companies/Hedge Funds/HFT is highly advantageous (either in industry or academic internships.


Keywords: Systems Engineer / C++ / GPU Virtualization / CUDA / Performance Optimization / Low-Level Programming / Distributed Systems / Cloud Infrastructure / Kernel / Drivers / ML Infrastructure / High-Performance Computing (HPC)


If you are interested in this Software Engineer position, please send a copy of your CV to ts@eu-recruit.com


By applying to this role you understand that we may collect your personal data and store and process it on our systems. For more information please see our Privacy Notice https://eu-recruit.com/wp-content/uploads/2024/07/European-Tech-Recruit-Privacy-Notice-2024.pdf

// // //