Your browser does not support javascript! Please enable it, otherwise web will not work for you.

AI Infrastructure System Engineer Bangalore

Home > Python programming jobs

AI Infrastructure System Engineer Bangalore in Others

  • Together AI
  • Full time
  • Email
  • Bengaluru, India

Responsibilities

  • Design and build fleet automation systems for provisioning, validation, deployment, upgrades, repairs, and retirement of GPU clusters.
  • Build AI infrastructure agents that automate deployment, root-cause analysis, incident triage, and remediation.
  • Develop fleet intelligence platforms to monitor hardware, firmware, networking, storage, thermals, and workload performance and predict failures.
  • Build software that improves GPU availability, utilization, performance, and reliability across thousands of accelerators.
  • Create automated validation systems for GPUs, networking fabrics, NVLink/NVSwitch, storage, and distributed AI workloads.
  • Build internal infrastructure platforms and developer tools that enable software-managed operations.
  • Improve deployment velocity, reliability, and operational efficiency through automation.
  • Partner with hardware, networking, platform, and AI teams on large-scale AI infrastructure.

Requirements

  • 3+ years of experience building distributed systems, infrastructure platforms, or large-scale backend software.
  • Strong software engineering skills in Python, Go, or Rust.
  • Experience building platforms, automation systems, or developer infrastructure.
  • Experience with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies.
  • Strong systems thinking across hardware and software.
  • Passion for solving complex infrastructure challenges through software and an automation-first mindset.
  • Bonus experience with GPU infrastructure, CUDA, NCCL, NVLink/NVSwitch, InfiniBand, RoCE, bare-metal provisioning, AI training or inference clusters, hardware health monitoring, predictive failure detection, distributed storage, or AI agents.

Together AI

Together AI is the AI Native Cloud, purpose-built for AI engineers and researchers with a full suite of tooling across inference, model shaping, and pre-training. AI natives can use Together AI as a full-stack AI platform — from a high- performance inference engine built for reliable and fast sca...

Similar positions

Senior Software Engineer, Data Platform

  • Doximity
  • Full time
  • USA
  • 11/20/2026
  • Remote

Software Engineer 5, AI Observability

  • Netflix
  • Full time
  • USA
  • 11/20/2026
  • Salary: $500k-$860k
  • Remote

Sr. Superintelligence (SI) Engineer

  • SpaceX
  • Full time
  • USA
  • 11/20/2026
  • Salary: $220k - $350k/yr
  • Hawthorne, CA

Consultant/Senior Consultant, Data Engineering

  • Baringa
  • Full time
  • UK
  • 11/20/2026
  • London

Sr. Superintelligence (SI) Engineer

  • SpaceX
  • Full time
  • USA
  • 11/20/2026
  • Salary: $220k - $350k/yr
  • Palo Alto, CA