Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Sr. Software Engineer, Kernels/CUDA

Home > C/C++ programming jobs

Sr. Software Engineer, Kernels/CUDA in USA new

  • Palo Alto, CA

Responsibilities

  • Design, build, and optimize massive GPU clusters for extreme-scale training and inference workloads.
  • Develop and tune low-level CUDA kernels, including GeMM and attention kernels, using CUTLASS, Tensor Cores, and Nsight.
  • Profile, debug, and eliminate bottlenecks across GPU memory hierarchy, networking fabric, filesystems, and multi-GPU operations.
  • Collaborate with AI research teams to deliver production-grade performance and scalability.

Requirements

  • At least 5 years of experience with low-level systems programming in C/C++.
  • Deep low-level systems-programming experience with C, C++, PTX, or SASS.
  • Strong experience with large-scale GPU clusters or distributed compute infrastructure at production scale.
  • Hands-on experience with GPU kernel optimization, including CUTLASS, custom kernels, and Nsight profiling.
  • A track record of building or operating high-performance infrastructure for AI training or inference workloads.
  • Ability to optimize memory-bound and compute-bound workloads from first principles.

Benefits

  • Equity.
  • Comprehensive medical, vision, and dental coverage.
  • 401(k) retirement plan.
  • Short- and long-term disability insurance.
  • Life insurance, discounts, and other perks.

Salary: $200k - $375k/yr

xAI

xAI builds advanced AI systems designed to deeply understand the universe and support humanity's quest for knowledge. Targeting innovators and thinkers, our platform emphasizes engineering excellence and hands-on collaboration, fostering an environment where curiosity drives results.

Similar positions

Senior Spacecraft Flight Software Engineer

  • Varda Space Industries
  • Full time
  • USA
  • 11/06/2026
  • Salary: $169k - $216k/yr
  • El Segundo, CA

Staff Software Engineer, Compiler

  • Code Metal
  • Full time
  • USA
  • 11/05/2026
  • Salary: $170k - $250k/yr
  • Remote

Software Engineer

  • Averna
  • Full time
  • UK
  • 11/05/2026
  • Christchurch

Software Development Engineer - Cellular |

  • Apple
  • Full time
  • USA
  • 11/05/2026
  • San Diego, CA

Sr. Software Engineer, Linux Kernel

  • xAI
  • Full time
  • USA
  • 11/05/2026
  • Salary: $200k - $375k/yr
  • Palo Alto, CA