Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Backend Software Engineer, Infrastructure

Home > Python programming jobs

Backend Software Engineer, Infrastructure in USA new

  • San Francisco, CA

Responsibilities

  • Design and build multi-tenant platform services providing isolated capacity, routing, quotas, and observability.
  • Scale the gateway used to provide reliable, fair, and cost-aware access to model providers.
  • Build internal platforms, APIs, sandboxes, job execution systems, and service frameworks for engineering teams and coding agents.
  • Design data models, storage layers, and workflows using Postgres, MongoDB, and Temporal, including schema evolution, sharding, partitioning, and migrations.
  • Write design documents, lead architecture reviews, and establish patterns for concurrency, retries, idempotency, and backpressure.
  • Improve performance and efficiency on hot paths and make architectural changes that reduce infrastructure costs.
  • Participate in weekly on-call rotations and contribute to developer productivity initiatives such as CI improvements, test reliability, and internal tooling.

Requirements

  • Strong software engineering fundamentals and the ability to write, test, and review production-quality Python or Go code.
  • Deep understanding of distributed systems concepts including consistency, concurrency, failure modes, backpressure, idempotency, and capacity planning.
  • Experience designing APIs and services used by other engineers and evolving them without breaking consumers.
  • Experience with relational and/or document databases, including data modeling, query performance, and safe migrations.
  • Working familiarity with AWS and containerized infrastructure.
  • High ownership and the ability to propose, ship, and support systems in production.
  • Experience with internal platforms, SDKs, shared services, multi-tenant systems, rate limiting, quota systems, API gateways, LLM or inference serving, databases, message queues, or workflow engines is valuable.
  • Experience with developer experience tooling such as CI pipelines, build systems, local development environments, or internal CLIs is preferred.

Benefits

  • Bi-annual performance bonus structure and equity grant vested over four years.
  • Health, dental, and vision insurance, plus a 401(k) with company match.
  • Unlimited paid vacation and sick days, parental leave, and free mental health services.
  • $200 monthly wellness reimbursement, $1.5K monthly meal stipend, $200 monthly laundry reimbursement, and free Equinox membership.
  • Up to $15K relocation bonus and a $10K housing bonus for employees living within 0.5 miles of the office.
  • Work in person five days per week in San Francisco, New York, or London; the infrastructure team has a weekly on-call rotation.

Salary: $160k - $500k/yr

Mercor

We find the best experts in every professional domain and put their knowledge to work training frontier models. Through APEX, we measure whether those models can actually perform economically valuable work. We're also bringing that expertise to enterprises: deploying custom AI agents, staffing te...

Similar positions

MLOps / DevOps Engineer - AI Infrastructure

  • CreatorIQ
  • Full time
  • USA
  • 11/22/2026
  • Salary: $121k - $155k/yr
  • Los Angeles, CA

Software Engineer, Voice AI / Backend

  • Clera
  • Full time
  • Others
  • 11/22/2026
  • Berlin, Germany

Principal Software Security Engineer

  • Rocket Lab Corporation
  • Full time
  • USA
  • 11/22/2026
  • Salary: $150k - $215k/yr
  • Littleton, CO

Principal Software Security Engineer

  • Rocket Lab Corporation
  • Full time
  • USA
  • 11/22/2026
  • Salary: $173k - $259k/yr
  • Long Beach, CA

Software Engineer I, Backend

  • Affirm
  • Full time
  • USA
  • 11/22/2026
  • Salary: $115k - $180k/yr
  • Remote