Senior Deep Learning Software Engineer, Inference
NVIDIA
Opportunity published from Workday · applications stay with the original hiring source.
About the opportunity
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference to join our growing team.
You will help design, build, and optimize GPU-accelerated software powering sophisticated AI applications, developing and maintaining high-performance open-source frameworks for efficient large-scale model serving and inference.
You will work closely with the deep learning community to implement the latest algorithms for public release, focusing on performance improvements for state-of-the-art LLM and Generative AI models across NVIDIA accelerators from datacenter GPUs to edge SoCs.
You will utilize open-source tools and plugins, including CUTLASS, OAI Triton, NCCL, and CUDA kernels, to implement and optimize model serving pipelines in a hybrid work environment.
Key responsibilities
- Performance optimization, analysis, and tuning of DL models in various domains like LLM, Multimodal and Generative AI.
- Scale performance of DL models across different architectures and types of NVIDIA accelerators.
- Contribute features and code to NVIDIA’s inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions.
- Work with cross-collaborative teams across frameworks, NVIDIA libraries and inference optimization innovative solutions.
Qualifications
- Masters or PhD or equivalent experience in relevant field (Computer Engineering, Computer Science, EECS, AI).
- 5+ years of relevant software development experience.
- Excellent C/C++ programming and software design skills.
Nice to have
- SW Agile skills and Python experience.
- Prior experience with training, deploying or optimizing the inference of DL models in production.
- Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU.
- GPU programming experience (CUDA, OAI TRITON or CUTLASS).
- Contribute to deep learning software projects, such as PyTorch, vLLM, and SGLang to drive advancements in the field.
Benefits
- Highly competitive salaries and a comprehensive benefits package.
- Eligibility for equity and benefits.
Job details
- Location: Hybrid (#LI-Hybrid)
- Base salary range: 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4 (determined based on location, experience, and peer pay).
- Application deadline: Accepted at least until October 16, 2026.
About the company
NVIDIA is widely considered to be one of the technology world's most desirable employers, featuring forward-thinking and hardworking people. Due to outstanding growth, our special engineering teams are expanding rapidly.
Additional information
- NVIDIA uses AI tools in its recruiting processes.
Application: UpVagas lists this opportunity from the hiring company or its recruitment platform. The application is completed at the original source.
Key details from the source
- Experience with Multi GPU Communications (NCCL, NVSHMEM).
Full listing
UpVagas condensed repetitive or legal boilerplate to make this page easier to read. The original hiring source contains the complete job description.
