Your browser does not support javascript! Please enable it, otherwise web will not work for you.

AI Infrastructure Engineer [Tooling]

Home > Python programming jobs

AI Infrastructure Engineer [Tooling] in USA

  • Tessera Labs
  • Full time
  • Email
  • Remote

Responsibilities

  • Build and maintain Python or Go CLIs, SDKs, and services for provisioning, deploying, testing, and debugging AI agents.
  • Deploy, scale, and tune LLM inference with vLLM or comparable serving stacks, including GPU scheduling, autoscaling, batching, and cost and latency optimization.
  • Build multi-agent infrastructure including agent runtimes, tool and connector execution, sandboxing, state management, and safe agent-version rollouts.
  • Own MLOps workflows for model and prompt versioning, evaluation pipelines, artifact registries, and staging-to-production promotion.
  • Write Kubernetes operators and custom controllers using CRDs to manage AI workloads.
  • Design, build, and operate production AI infrastructure with Kubernetes and Terraform across Azure, Oracle Cloud, GCP, and AWS.
  • Improve observability for agent and LLM calls, including tracing, token and GPU utilization, latency, errors, and cost.
  • Design and own CI/CD, GitOps, release automation, environment provisioning, secret rotation, dependency updates, and compliance checks.
  • Partner with AI, product, and platform engineers while mentoring others and contributing to platform technical direction at the senior level.

Requirements

  • 5+ years of experience in infrastructure, platform, or backend engineering; 7+ years for senior level.
  • Strong production software engineering experience in Python or Go, including tools, CLIs, or services used by other engineers.
  • Hands-on experience running production LLM workloads with vLLM or comparable stacks such as TGI, Triton, SGLang, or Ray Serve.
  • Experience building infrastructure for AI agents or LLM applications, including orchestration, tool calling, evaluation, or agent runtimes.
  • Practical MLOps experience with model and prompt versioning, evaluation and release pipelines, and ML-system observability.
  • Strong Kubernetes experience, including writing or extending operators and controllers with tools such as Kubebuilder, Operator SDK, controller-runtime, or Kopf.
  • Strong Terraform experience and hands-on experience with at least one of Azure, Oracle Cloud, GCP, or AWS.
  • Proven experience designing and owning CI/CD systems, GitOps deployments, release automation, and production systems.
  • Solid networking fundamentals.
  • Preferred experience includes GPU infrastructure, agent frameworks and protocols, LLM observability, GitOps controllers, cloud security, DevSecOps, service mesh, private connectivity, multi-cloud networking, and open-source contributions.
  • Ability to make and defend infrastructure decisions, work independently, write production-quality code, and operate effectively in startup or big-tech environments.

Benefits

  • Opportunity to work on cutting-edge AI infrastructure with enterprise impact.
  • Ownership of foundational systems at an early-stage, high-growth company.
  • Collaboration with an execution-focused founding team.
  • Opportunity to shape how AI agents are deployed across major enterprise platforms.

Salary: $200k - $230k/yr

Tessera Labs

Enterprise transformations shouldn't take years or cost fortunes. At Tessera, we've built a multi-agent AI platform that cuts ERP transformation timelines from years to weeks and reduces costs by more than half—while delivering first-time-right outcomes with enterprise-grade security and governan...

Similar positions

Senior Software Engineer, Data Platform

  • Doximity
  • Full time
  • USA
  • 11/20/2026
  • Remote

Software Engineer 5, AI Observability

  • Netflix
  • Full time
  • USA
  • 11/20/2026
  • Salary: $500k-$860k
  • Remote

Sr. Superintelligence (SI) Engineer

  • SpaceX
  • Full time
  • USA
  • 11/20/2026
  • Salary: $220k - $350k/yr
  • Hawthorne, CA

Consultant/Senior Consultant, Data Engineering

  • Baringa
  • Full time
  • UK
  • 11/20/2026
  • London

Sr. Superintelligence (SI) Engineer

  • SpaceX
  • Full time
  • USA
  • 11/20/2026
  • Salary: $220k - $350k/yr
  • Palo Alto, CA