Software Engineer, ML Infra

Home > Other programming jobs

Software Engineer, ML Infra in USA

Thinking Machines Lab
Full time
Email

USA
08/28/2026
Report

San Francisco, CA

Responsibilities

Debug root causes across the kernel, NCCL, scheduler, application, and telemetry layers.
Provide embedded, hands-on support during critical training runs and major incidents through resolution.
Act as the primary technical contact for researchers when infrastructure problems have unclear ownership.
Lead postmortems and build tooling to prevent recurring incidents.
Mentor engineers in cross-stack infrastructure debugging and operations.

Requirements

Demonstrated hands-on competence in at least four of Linux kernel, networking, GPUs/CUDA, distributed systems runtimes, storage, compilers/language runtimes, and observability internals.
Ability to operate without clearly defined ownership and exercise sound escalation judgment.
Preferred: experience as an escalation point across two or more companies.
Preferred: meaningful contributions across three or more distinct technical stacks.
Preferred: experience leading major incidents with non-obvious root causes.
Preferred: comfort working directly with researchers and communicating workload constraints clearly.
Preferred: experience operating frontier training or inference clusters and owning difficult, undefined infrastructure problems.

Benefits

Annual base salary of $350,000–$475,000 USD plus equity.
Generous health, dental, and vision benefits.
Unlimited paid time off.
Paid parental leave.
Relocation support as needed.
Visa sponsorship is available.
Role is based in San Francisco, California.

Salary: $350k - $475k/yr

Thinking Machines Lab

Thinking Machines Lab pioneers advanced AI research, blending cutting‑edge theory with practical applications to solve complex problems across industries. Our interdisciplinary team pushes the boundaries of machine learning, neural architecture, and cognitive modeling to deliver innovative soluti...

Similar positions

Backend Engineer, Security Platform

Vannevar
Full time

USA
09/13/2026
Salary: $150k - $215k/yr

Remote

INFRASTRUCTURE AND PLATFORM ARCHITECT L2

Wipro
Full time

Others
09/13/2026

Bengaluru, India

Senior DevOps Engineer, Infrastructure & Reliabili

Worth AI
Full time

USA
09/13/2026

Remote

Software Development Engineer II

Amazon
Full time

Canada
09/13/2026

Toronto

Software Engineer Leader

Entefy
Full time

USA
09/13/2026

Remote