Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior Software Engineer, AI Gateway

Home > Rust programming jobs

Senior Software Engineer, AI Gateway in Others new

  • Shanghai, China

Responsibilities

  • Design, build, and maintain API management software and its underlying stack.
  • Architect and implement proxying, load balancing, database-support, and other Kong core features.
  • Troubleshoot bugs, tune performance, and perform low-level optimizations.
  • Integrate Kong with third-party deployment platforms and tooling.
  • Engage with the open-source community and extend Kong core for emerging industry use cases.
  • Write product documentation and collaborate with a remotely distributed team.

Requirements

  • 8+ years of programming experience in server-side applications and components.
  • Experience designing, prototyping, building, and debugging highly scalable, distributed, reliable, and resilient applications.
  • Hands-on expertise troubleshooting and profiling Linux systems.
  • Experience with distributed systems, the Linux networking stack, and computer systems programming, including L4 and L7 transports and protocols.
  • Familiarity with AI and LLM concepts and application development.
  • Strong ownership, communication, and technical documentation skills.
  • Experience with NGINX, OpenResty, Kong, or LuaJIT is a bonus.
  • Experience with Envoy, Istio, or Rust is a bonus.

Kong

Kong builds an open-source and commercial platform for API and AI connectivity, including Kong Gateway, Kong Konnect, and service mesh tools (Kuma/Kong Mesh) to secure, manage, and observe APIs and LLM traffic across clouds. It sells subscriptions and cloud services for API lifecycle management, ...

Similar positions

Senior Software Engineer, API Gateway

  • Kong
  • Full time
  • Others
  • 10/24/2026
  • Shanghai, China

Backend Engineer, Knowledge Graph (Rust)

  • GitLab
  • Full time
  • Remote
  • 10/23/2026
  • Salary: $115k-$162k
  • Canada, USA

Senior Software Engineer, AI Gateway

  • Kong
  • Full time
  • Others
  • 10/23/2026
  • Shanghai, China

Sr Staff Software Engineer Distributed

  • ServiceNow
  • Full time
  • Remote
  • 10/23/2026
  • Salary: $171k-$300k
  • United States

Staff Software Engineer - Market Data

  • Dune
  • Full time
  • Remote
  • 10/23/2026
  • Salary: Competitive
  • Europe, North America