[…] is seeking an exceptional Manager, Deep Learning Inference Software, to lead a world-class engineering team advancing the state of AI model deployment. You will shape the software powering today’s most sophisticated AI systems — from large language models to multimodal generative AI — all accelerated on […] GPUs. The Deep Learning Inference team develops and optimizes open-source frameworks that make AI deployment scalable, efficient, and accessible — including vLLM / SGLang, and FlashInfer.
Our work enables developers worldwide to harness […] accelerators for real-time inference at every scale, from datacenter clusters to edge devices.
Lead, mentor, and scale a high-performing engineering team focused on deep learning inference and GPU-accelerated software.
Drive the strategy, roadmap, and execution of […]’s inference frameworks engineering, focusing on Client AI.
Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized inference pipelines across […] accelerators.
Oversee performance tuning, profiling, and optimization of large-scale models for LLM, multimodal, and generative AI applications.
Guide engineers in adopting best practices for CUDA, Triton, CUTLASS, and multi-GPU communications (NIXL, NCCL, NVSHMEM).
Represent the team in roadmap and planning discussions, ensuring alignment with […]’s broader AI and software strategies.
Foster a culture of technical excellence, open collaborat