Your browser does not support javascript! Please enable it, otherwise web will not work for you.

AIML - LLM Inference Quality Engineer

Home > Python programming jobs

AIML - LLM Inference Quality Engineer in USA new

  • Seattle, WA

Responsibilities

  • Lead qualification of LLM inference and output-correctness automation for large-scale AI data center deployment.
  • Architect evaluation and qualification systems for generative AI, including agentic workflows and tool-using models.
  • Validate correctness, consistency, and stability across models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware.
  • Write production-quality software in Python, C++, and/or Swift for AI systems qualification and testing.
  • Apply statistical and machine-learning evaluation methods to validate model behavior and data.
  • Build AI-assisted QA tooling for test-case generation, defect detection, and reduced manual testing.
  • Integrate automated evaluations into release pipelines and partner with ML, inference, distributed systems, and platform teams.
  • Define quality standards for probabilistic and non-deterministic LLM inference at scale.

Requirements

  • At least 1 year of experience with hardware and/or software development lifecycle processes.
  • At least 1 year of experience with one or more compiled languages such as C, C++, Objective-C, or Swift.
  • Proficiency in a scripting language such as Python, Go, or JavaScript.
  • Experience using AI or LLMs to improve testing, including test-case generation, defect detection, or QA automation.
  • Familiarity with LLM serving, inference optimization, GPU-accelerated software, and techniques including batching, KV-cache, quantization, speculative decoding, and distributed multi-accelerator serving.
  • Experience with Kubernetes, containers, cloud-native systems, and automated evaluation integration.
  • Experience with machine learning, LLMs, and frameworks such as PyTorch or Hugging Face Transformers.
  • Experience with observability, distributed tracing, and model-drift monitoring using tools such as Splunk, Prometheus, Grafana, or LangSmith.
  • B.S., M.S., or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or equivalent experience.
  • Preferred: 5+ years using Python, Go, or JavaScript.
  • Preferred: 5+ years working with and building operating systems.
  • Preferred: 2+ years of LLM testing or development.

Apple

We’re a diverse collective of thinkers and doers, continually reimagining what’s possible to help us all do what we love in new ways. And the same innovation that goes into our products also applies to our practices — strengthening our commitment to leave the world better than we found it. This i...

Similar positions

AI/ML Engineer

  • DeepIntent
  • Full time
  • Others
  • 11/20/2026
  • Pune, India

Senior Security Engineer

  • Shiftsmart
  • Full time
  • USA
  • 11/20/2026
  • Salary: $155k - $220k/yr
  • New York, NY

Engineer Sr Analyst - C12 - PUNE

  • Citi
  • Full time
  • Others
  • 11/20/2026
  • Pune, India

Senior Data Engineer - Knowledge Ingestion

  • Solvd
  • Full time
  • Remote
  • 11/20/2026
  • US

Principal Engineer - Machine Learning Platform

  • PubMatic
  • Full time
  • Others
  • 11/20/2026
  • Pune, India