Your browser does not support javascript! Please enable it, otherwise web will not work for you.

QA Engineering Lead (AI)

Home > Python programming jobs

QA Engineering Lead (AI) in USA new

  • Menlo Park, CA

Responsibilities

  • Own the end-to-end quality strategy for a GenAI product area from development and model evaluation through launch and product improvements.
  • Perform hands-on testing of consumer-facing and business-facing applications, APIs, AI models, backend systems, and infrastructure.
  • Design and maintain AI model evaluation processes using representative datasets, weighted scoring, automated evaluations, human review, and regression coverage.
  • Establish product-specific standards for model correctness, relevance, safety, and robustness.
  • Plan and execute functional, integration, end-to-end, performance, stress, and cross-platform testing.
  • Build reusable test automation and evaluation tooling and integrate quality checks into development workflows.
  • Define quality metrics, analyze failures and coverage gaps, and drive improvements in testing effectiveness and product quality.
  • Lead cross-team quality projects, advise on release readiness, investigate root causes, and prevent recurring defects.
  • Mentor QA engineers in test design, automation, and AI evaluation.

Requirements

  • Bachelor’s degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience; the degree must be completed before joining Meta.
  • At least 7 years of experience in quality assurance and test engineering for software products or services.
  • At least 2 years of experience in AI model testing or evaluation, including developing evaluation methods and defining model quality standards.
  • Experience independently leading quality engineering for a complex product or system and delivering measurable improvements.
  • Experience developing test automation or evaluation tooling in Python, PHP, Java, C/C++, or an equivalent programming language.
  • Hands-on experience testing and debugging web or mobile applications, APIs, backend services, and AI models.
  • Experience with test planning, test design and execution, performance and stress testing, and client and server test automation.
  • Experience using metrics and failure analysis to prioritize improvements and inform release decisions.
  • Experience coordinating work across engineering and cross-functional partners, communicating technical risks and trade-offs, and mentoring engineers.
  • Preferred experience includes building reusable testing or evaluation frameworks, responsible AI practices, human and automated model evaluation, frontier model evaluation, multimodal model testing, prompt/context engineering, agent orchestration, and partnering with AI research teams.

Benefits

  • $138,000/year to $191,000/year plus bonus, equity, and benefits.

Salary: $138k - $191k/yr

Meta

Meta builds social platforms and communication apps—including Facebook, Instagram, WhatsApp, and Messenger—and develops AR/VR hardware and software such as Quest to power immersive computing. It monetizes primarily through advertising tools for businesses, with additional revenue from devices and...

Similar positions

Lead Data Engineer

  • Elastic
  • Full time
  • USA
  • 11/07/2026
  • Salary: $113k-$215k
  • Remote

Lead Mobile QA Automation Engineer

  • Unanet
  • Full time
  • USA
  • 11/07/2026
  • Salary: $130k - $140k/yr
  • Remote

Senior Engineer, QA

  • ASM
  • Full time
  • USA
  • 11/07/2026
  • Phoenix, AZ

Backend Engineer - GTM Engineering

  • Secfix
  • Full time
  • Remote
  • 11/07/2026
  • Salary: $20k-$32k
  • India

Sr. Software Engineer, Data Engineering

  • xAI
  • Full time
  • USA
  • 11/07/2026
  • Salary: $180k - $330k/yr
  • Palo Alto, CA