Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Software Engineer, TPU Compilers

Home > Other programming jobs

Software Engineer, TPU Compilers in USA

  • San Francisco, CA

Responsibilities

  • Optimize model execution on TPUs across model code, kernels, and hardware.
  • Profile workloads, identify bottlenecks, and improve latency, throughput, and hardware utilization.
  • Develop and optimize kernels based on model behavior and performance requirements.
  • Explore quantization and related techniques to improve inference efficiency while preserving model quality.
  • Build benchmarks and tools to measure performance, validate correctness, and guide optimization.
  • Partner with researchers and engineers to support new model architectures and productionize performance improvements.

Requirements

  • Practical experience optimizing machine learning workloads on TPUs through training, inference, or both.
  • Understanding of modern model architectures and how their computation maps onto accelerator hardware.
  • Ability to connect kernel behavior to complete-model performance across multiple layers of the stack.
  • Strong software engineering skills and a systematic approach to profiling, debugging, and validating performance improvements.
  • Ability to own open-ended technical problems, prioritize work, make design decisions, and deliver solutions.
  • Collaborative communication skills and ability to explain technical tradeoffs.
  • Experience with quantization or attention kernels is especially useful.

Salary: $380k - $500k/yr

OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. AI is an extremely powerful tool that must be created with safety and human needs at its core. OpenAI is dedicated to putting that alignment of interests fi...

Similar positions

Senior Software QA Engineer

  • Epiq
  • Full time
  • Others
  • 10/25/2026
  • Pune, India

Senior Security Engineer, AM/CIAM

  • GuidePoint Security
  • Full time
  • USA
  • 10/25/2026
  • Remote

Principal Software Engineer

  • CaptivateIQ
  • Full time
  • Remote
  • 10/25/2026
  • Poland

Senior Engineer, Cybersecurity (R6438)

  • Shield AI
  • Full time
  • USA
  • 10/25/2026
  • Salary: $142k - $213k/yr
  • Seattle, WA

Staff Software Engineer - API Platform

  • Canva
  • Full time
  • Australia
  • 10/25/2026
  • Remote

Listings

by


Job Type

Language

Country

CodingJobBoard.com © 2026