Principal Software Engineering (AI Infrastructure)

Home > Golang programming jobs

Principal Software Engineering (AI Infrastructure) in USA

TSMC
Full time
Email

USA
09/27/2026
Report

Vancouver, WA

Responsibilities

Lead the architecture and long-term technical strategy for TSMC’s AI platform, enterprise AI gateway, multi-model inference platform, GPU infrastructure, governance, and observability.
Design and build scalable enterprise AI infrastructure for LLM serving, GPU scheduling, model routing, model lifecycle management, RAG infrastructure, vector databases, and AI orchestration.
Lead distributed-systems architecture for highly available AI services, multi-region deployment, disaster recovery, service mesh, distributed caching, event-driven architecture, and global load balancing.
Drive AI platform engineering practices involving Kubernetes, Platform-as-a-Service, and AI deployment automation.
Collaborate with engineering teams in North America and Taiwan to support secure, scalable, and reliable AI services across global regions.

Requirements

BS, MS, or PhD in Computer Science or a related field.
At least 7 years of software engineering experience.
At least 3 years leading architecture for distributed systems or cloud infrastructure.
At least 2 years of hands-on experience designing enterprise AI platforms.
At least 1 year of experience as a Principal Engineer, Staff Engineer, Distinguished Engineer, or Technical Lead.
Strong experience with LLM inference, enterprise AI gateways, AI serving infrastructure, GPU scheduling, multi-model AI architecture, and model lifecycle management.
Deep expertise with cloud-native infrastructure and experience with NVIDIA GPU technologies, vLLM, TensorRT-LLM, Triton Inference Server, Ray, Kubeflow, MLflow, Kubernetes, Docker, Helm, ArgoCD, service mesh, and AWS, Azure, or GCP.
Strong programming skills in one or more of Go, Python, or Java, plus experience with REST APIs, microservices, and SDKs.
Strong technical communication skills for collaboration with global cross-functional teams.
Legal authorization to work in the United States without current or future visa sponsorship; employment is contingent on passing a background check and drug screening.

Benefits

Starting base salary typically ranges from $137,300 to $183,650 per year, with the full job-grade base salary range extending from $137,300 to $199,100.
Profit sharing, incentive bonuses, and tuition assistance are included in the total compensation package.
Medical, dental, vision, life insurance, and a 401(k) plan with employer match are provided.
Employees receive 12 holidays per year and accrue paid time off annually.
Onsite amenities include a fitness center, game room, physical therapist, and subsidized café.
The position is onsite in Vancouver, Washington, Monday through Friday during core hours of 8 a.m. to 5 p.m.; additional hours may be required for project demands.

Salary: $137k - $184k/yr

TSMC

TSMC (Taiwan Semiconductor Manufacturing Company) is a pure-play semiconductor foundry that manufactures integrated circuits for fabless and systems companies on a contract basis. Founded in 1987 and headquartered in Hsinchu, Taiwan, it is the world’s largest chip foundry, with advanced process n...

Similar positions

Senior Software Engineer

MariaDB plc
Full time

USA
10/26/2026
Salary: $141k-$185k

Remote

Software Engineer, Ads

Reddit
Full time

USA
10/25/2026
Salary: $164k-$230k

Remote

Principal Software Engineer (AI Security)

Cyberhaven
Full time

Remote
10/25/2026

Europe, India

SOFTWARE ENGINEER GO PL

Stone - Linkedin
Full time

Remote
10/25/2026

Brazil

SOFTWARE ENGINEER GO PLENO

Stone - Linkedin
Full time

Remote
10/24/2026

Brazil