Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Applied AI Engineer, Evals

Home > Other programming jobs

Applied AI Engineer, Evals in USA

  • San Francisco, CA

Responsibilities

  • Design evaluations for voice, vision, and browser use to guide improvements in the agent, context, and models.
  • Build and maintain internal benchmarks and simulations.
  • Develop systems to score customer-specific scenarios and identify gaps in current capabilities.
  • Use evaluation findings to optimize the agent, context, and models.

Requirements

  • Engineering experience with statistics and/or applied machine learning.
  • Comfort working in a production codebase.
  • Prior experience with evaluations, voice, realtime systems, or browser/computer-use agents is a bonus.

Sable

Sable empowers businesses to unlock their full potential through innovative technology solutions and strategic consulting. By blending deep industry expertise with a customer‑centric approach, we help organizations streamline operations, accelerate growth, and stay ahead of market trends. Our col...

Similar positions

Identity & Access Management Engineer, Lead

  • Toyota North America
  • Full time
  • USA
  • 11/06/2026
  • Plano, TX

Software Engineer, Backend (Trading)

  • Phantom
  • Full time
  • USA
  • 11/06/2026
  • Salary: $200k - $250k/yr
  • Remote

AI Forward Deployed Engineer

  • Telnyx
  • Full time
  • USA
  • 11/06/2026
  • Remote

Senior Engineer, Integration, India

  • ResourcePro
  • Full time
  • Others
  • 11/06/2026
  • Bengaluru, India

Associate QA Engineer, Software

  • Light & Wonder, Inc.
  • Full time
  • Others
  • 11/06/2026
  • Salary: Competitive
  • Bengaluru, India