On-device ML Infrastructure Engineer

Home > Python programming jobs

On-device ML Infrastructure Engineer in USA

Apple
Full time
Email

USA
09/03/2026
Report

Cupertino, CA

Responsibilities

Develop and improve core runtime infrastructure for machine learning model execution across Apple devices.
Build model orchestration capabilities focused on execution stability and performance.
Collaborate with model authoring, compiler, and runtime teams.
Support model optimization, transformation, debugging, profiling, benchmarking, and analysis workflows.
Work on ML execution across CPU, GPU, Neural Engine, embedded systems, and larger compute environments.
Write kernels and contribute to tooling for efficient ML model execution.

Requirements

3–5 years of experience working on tooling built in Python 3 and C++ or Swift.
Familiarity with common machine learning model architectures, execution schemes, and operations.
Familiarity with PyTorch or related training frameworks.
Preferred: experience working on or adjacent to MLIR-based compilers.
Preferred: familiarity with deploying applications or tooling on Apple platforms.
Preferred: familiarity with programming paradigms for GPUs, CPUs, and Neural Engine hardware.
Preferred: familiarity with writing kernels for machine learning model execution.

Apple

We’re a diverse collective of thinkers and doers, continually reimagining what’s possible to help us all do what we love in new ways. And the same innovation that goes into our products also applies to our practices — strengthening our commitment to leave the world better than we found it. This i...

Similar positions

Backend Engineer (Europe)

Kalepa
Full time

Remote
10/26/2026
Salary: $80k-$105k

Europe

Sr. AI/ML Engineer II

MetroStar
Full time

USA
10/26/2026
Salary: $200k - $240k/yr

Reston, VA

Staff Security Engineer

Quince
Full time

Others
10/26/2026

Bengaluru, India

ChatGPT Performance Engineer

OpenAI
Full time

USA
10/26/2026
Salary: $325k-$405k

Remote

Junior Backend Engineer (Europe)

Kalepa
Full time

Remote
10/25/2026
Salary: $60k-$70k

Europe