Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior Software Engineer, Model Evaluation

Home > Other programming jobs

Senior Software Engineer, Model Evaluation in USA new

  • San Francisco, CA

Responsibilities

  • Design and build evaluation suites for manufacturing and supply-chain workflows.
  • Create tasks, reference answers, rubrics, graders, and quality checks with domain experts.
  • Train and fine-tune models using evaluation results to guide experiments.
  • Identify agent failures, improve production systems, and measure the impact of changes.
  • Help establish the team’s research and evaluation practices.

Requirements

  • At least 3 years of experience operating at a senior or staff level.
  • Hands-on experience designing benchmarks and evaluations, including tasks, reference solutions or rubrics, and quality checks.
  • Practical experience training and fine-tuning models rather than only using models through APIs.
  • Ability to translate knowledge from non-ML domain experts into measurable tasks.
  • Supply-chain, procurement, manufacturing, or early-stage startup experience is helpful.

Benefits

  • Equity is included in the compensation package.
  • Hybrid work arrangement in San Francisco, California.

Salary: $180k - $250k/yr

Clera

Clera harnesses the power of artificial intelligence to match high-growth startups with exceptional talent, streamlining the entire headhunting process. This innovative approach simplifies the job search for candidates while providing startups with access to a curated pool of skilled professional...

Similar positions

Senior Devops Engineer

  • Lloyds Banking Group
  • Full time
  • Others
  • 11/20/2026
  • Hyderābād, India

Staff AI Engineer, Internal Tools

  • RVO Health
  • Full time
  • Remote
  • 11/20/2026
  • Salary: $170k-$200k
  • United States

Senior Analytics Engineer

  • Air New Zealand
  • Full time
  • Others
  • 11/20/2026
  • Auckland, New Zealand

Senior Microsoft Security Entra Engineer

  • GuidePoint Security
  • Full time
  • USA
  • 11/20/2026
  • Remote

Senior Quality Assurance Engineer

  • Vinted
  • Full time
  • Others
  • 11/20/2026
  • Vilnius, Lithuania