π Local Job Near You
Senior Engineer for AI Inference Strategy
NVIDIA Corporation
π
toronto, Canada
Location
toronto
Posted
May 28, 2026
Commute
Local Area
Local Opportunity Near You!
This job is in your area. Enjoy a short commute and work close to home.
Job Description
Lead innovative AI inference strategies as a Senior Software Engineer. Work directly with customers to optimize LLM serving within Kubernetes and Slurm for groundbreaking performance.
In this pivotal role, youβll employ your systems expertise, bolstered by over 5 years of experience, to enhance the deployment of AI inference workloads. You'll guide technical partnerships and solve complex problems, while documenting and sharing valuable insights across teams. Collaboration is key to driving effective solutions in both customer-facing and internal environments.
Key Responsibilities:
β’ Implement end-to-end benchmarking for LLM architectures
β’ Operate and optimize vLLM on GPU clusters
β’ Develop comprehensive performance plans
β’ Share technical documentation and insights
β’ Foster collaboration with kernel engineering teams
Requirements:
β’ 5+ years of relevant engineering experience
β’ Advanced degrees in Comput...
In this pivotal role, youβll employ your systems expertise, bolstered by over 5 years of experience, to enhance the deployment of AI inference workloads. You'll guide technical partnerships and solve complex problems, while documenting and sharing valuable insights across teams. Collaboration is key to driving effective solutions in both customer-facing and internal environments.
Key Responsibilities:
β’ Implement end-to-end benchmarking for LLM architectures
β’ Operate and optimize vLLM on GPU clusters
β’ Develop comprehensive performance plans
β’ Share technical documentation and insights
β’ Foster collaboration with kernel engineering teams
Requirements:
β’ 5+ years of relevant engineering experience
β’ Advanced degrees in Comput...