Senior Software Engineer, Inference

Home > Other programming jobs

Senior Software Engineer, Inference in USA

AssemblyAI
Full time
Email

USA
09/02/2026
Report

New York, NY

Responsibilities

Design and ship customer-facing APIs for new model capabilities from prototype through launch and iteration.
Scale inference infrastructure for more than 1 million API users.
Productionize research techniques into reliable, low-latency, customer-ready systems.
Partner with researchers, Applied teams, and customers to guide product and research direction.
Contribute to backend services, inference infrastructure, SDKs, and internal tooling.

Requirements

Strong backend engineering experience building and supporting machine learning infrastructure and/or production customer-facing APIs.
Curiosity about AI/ML and sufficient understanding of model behavior to make sound engineering decisions.
Ability to operate effectively amid ambiguous and shifting research and product timelines.
Strong collaboration skills across research, applied engineering, and customer-facing stakeholders.

Benefits

U.S. salary range of $190,000–$225,000 base pay.
High-ownership, fast-moving environment at a small growth-stage AI company.
Equal-opportunity workplace with an emphasis on inclusion and diverse backgrounds.

Salary: $190k - $225k/yr

AssemblyAI

AssemblyAI is a Speech AI company that develops advanced artificial intelligence models for speech recognition and voice understanding. Its platform enables developers and businesses to transform spoken language into actionable insights, helping them build intelligent applications powered by voic...

Similar positions

Sr. Software Engineer II

Samsara
Full time

Remote
10/04/2026

Poland

Member of Technical Staff, Software

Build AI
Full time

Others
10/04/2026
Salary: $150k - $500k/yr

Shenzhen, China

Senior Software Engineer, AI Enablement

Telnyx
Full time

Remote
10/04/2026

Argentina, Brazil

Senior Forward Deployed Engineer

Typeform
Full time

UK
10/04/2026

Remote

Software Engineer, OpenAI Presence

OpenAI
Full time

USA
10/04/2026
Salary: $230k - $385k/yr

San Francisco, CA