GPU Kernel Engineer

Home > C/C++ programming jobs

GPU Kernel Engineer in USA

Sciforium
Full time
Email

USA
09/29/2026
Report

San Francisco, CA

Responsibilities

Design, implement, and optimize custom GPU kernels using C++, PTX, CUDA, ROCm, Triton, and/or JAX Pallas.
Profile end-to-end ML operation performance and optimize large-scale LLM training and inference workloads.
Integrate low-level GPU kernels into PyTorch, JAX, and custom internal runtimes.
Develop performance models, identify bottlenecks, and deliver kernel-level performance improvements.
Collaborate with ML researchers, distributed systems engineers, and model-serving teams.
Work with NVIDIA and AMD hardware vendors and track GPU architecture and compiler/toolchain developments.
Contribute to tooling, documentation, benchmarking suites, and testing frameworks.

Requirements

5+ years of industry or research experience in GPU kernel development or high-performance computing.
Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics, or a related field.
Strong programming skills in C++ and Python, with familiarity with ML frameworks.
Deep expertise in CUDA/ROCm, GPU memory models, and performance optimization.
Hands-on experience with Triton and/or JAX Pallas for custom kernel development.
Strong understanding of PTX, GPU ASM, and low-level GPU execution.
Extensive experience writing and optimizing custom GPU kernels in C++ and PTX.
Experience integrating low-level kernels into PyTorch, JAX, or similar frameworks.
Experience with large-scale LLM training or inference.
Preferred qualifications include AMD GPU and ROCm optimization, JAX FFI, efficient model-serving frameworks, TPUs, XLA, and contributions to open-source ML systems, compilers, or GPU kernels.

Benefits

Medical, dental, and vision insurance.
401k plan.
Daily lunch, snacks, and beverages.
Flexible time off.
Competitive salary and equity.

Salary: $190k - $250k/yr

Sciforium

Sciforium is a dynamic marketplace that connects science fiction enthusiasts with a curated selection of books, collectibles, and fan experiences. We empower creators and fans alike by offering a platform that celebrates imagination, community, and the limitless possibilities of speculative story...

Similar positions

Embedded Development Engineer

Emerson Electric Co.
Full time

Others
10/04/2026

Pune, India

Intermediate Embedded Software Engineer

MITRE
Full time

USA
10/04/2026
Salary: $104k - $155k/yr

New Bedford, MA

Senior Embedded Software Engineer

Apex Technology, Inc.
Full time

USA
10/04/2026
Salary: $185k - $210k/yr

Los Angeles, CA

Bluetooth Development Engineer

Visteon Corporation
Full time

Others
10/04/2026

Chennai, India

Software Engineer II

Microsoft
Full time

USA
10/04/2026
Salary: $102k - $219k/yr

Redmond, WA