Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Founding Engineer, Environments + Data

Home > Other programming jobs

Founding Engineer, Environments + Data in USA

  • San Francisco, CA

Responsibilities

  • Design synthetic company environments with realistic email, records, and files for AI agents.
  • Build graders and evaluation systems for assessing agent performance, including performance beyond human reviewers' expertise.
  • Develop benchmarks reflecting real-world production performance.
  • Identify and fix evaluation failures, reward hacking, and benchmark gaming.
  • Simulate software tools such as inboxes and CRMs to support realistic agent interactions at scale.

Requirements

  • Experience building environments or benchmarks used by frontier AI labs to train or evaluate agents.
  • Hands-on experience designing and implementing AI agent graders or evaluation systems.
  • Experience simulating software systems that withstand agent tool use and building synthetic environments for production-like evaluation.
  • Track record of identifying flaws in widely used benchmarks and detecting and fixing reward hacking in graders.
  • Startup or early-stage company experience and strong competitive problem-solving experience in areas such as math, programming, debate, or games.
  • Collaborative approach to ambiguous, fast-paced work and strong conviction in AI agents' potential to perform computer-based work.

Benefits

  • Meaningful founding equity.
  • On-site five days a week in San Francisco, California.
  • Visa sponsorship availability requires confirmation because the supplied details differ.

Salary: $150k - $300k/yr

Clera

Clera harnesses the power of artificial intelligence to match high-growth startups with exceptional talent, streamlining the entire headhunting process. This innovative approach simplifies the job search for candidates while providing startups with access to a curated pool of skilled professional...

Similar positions

Senior Software Engineer, Model Evaluation

  • Clera
  • Full time
  • USA
  • 11/20/2026
  • Salary: $180k - $250k/yr
  • San Francisco, CA

Staff AI Engineer, Internal Tools

  • RVO Health
  • Full time
  • Remote
  • 11/20/2026
  • Salary: $170k-$200k
  • United States

Senior Software Engineer, Lifecycle

  • Life360
  • Full time
  • USA
  • 11/20/2026
  • Salary: $148k - $216k/yr
  • Remote

Security Engineer,AWS Security

  • Amazon
  • Full time
  • USA
  • 11/19/2026
  • Salary: $136k - $184k/yr
  • Austin, TX

Senior Software Engineer, Home Lending

  • Upstart
  • Full time
  • USA
  • 11/19/2026
  • Salary: $167k - $231k/yr
  • Remote