Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Research Engineer / Scientist, Data & Evals

Home > Python programming jobs

Research Engineer / Scientist, Data & Evals in USA

  • Remote

Responsibilities

  • Build synthetic data pipelines that generate, filter, and curate training and evaluation samples for legal reasoning and agentic workflows.
  • Design evaluations and verifiers, calibrate them against expert judgment, and investigate their failure modes.
  • Build and maintain capability benchmarks such as the Legal Agent Benchmark and product-focused evaluations for customer workflows.
  • Work with legal domain experts to define quality metrics, rubrics, and grading mechanisms.
  • Own training and evaluation data quality, including provenance, coverage, and contamination safeguards.
  • Connect product usage and customer feedback to new evaluations and training data.
  • Investigate model failures and use findings to guide training and release decisions.

Requirements

  • Experience building data pipelines, ML evaluation systems, or experimentation tooling.
  • Strong Python skills and experience owning production-quality code.
  • Rigorous understanding of measurement, statistical reasoning, experimental design, and misleading metrics.
  • Ability to translate ambiguous goals and expert judgment into structured datasets, rubrics, and measurable criteria.
  • Experience with synthetic data, LLM evaluations, automated raters, or preference data is preferred.
  • Strong data and measurement engineering experience close to ML model development is valuable even without prior LLM experience.

Benefits

  • Full-time role with compensation of $230,000-$450,000 USD depending on location.

Salary: $230k - $340k/yr

Harvey

Harvey is domain-specific AI for legal and professional services. Adopted by Fortune 500 companies like AT&T, Verizon, Cox, Koch, KKR, Bridgewater, more than 100,000 lawyers across 2,400+ customers in 70 countries and over 75% of AmLaw 100 law firms rely on Harvey to advance legal expertise faste...

Similar positions

AI/ML Engineer

  • DeepIntent
  • Full time
  • Others
  • 11/20/2026
  • Pune, India

Senior Security Engineer

  • Shiftsmart
  • Full time
  • USA
  • 11/20/2026
  • Salary: $155k - $220k/yr
  • New York, NY

Engineer Sr Analyst - C12 - PUNE

  • Citi
  • Full time
  • Others
  • 11/20/2026
  • Pune, India

Senior Data Engineer - Knowledge Ingestion

  • Solvd
  • Full time
  • Remote
  • 11/20/2026
  • US

Principal Engineer - Machine Learning Platform

  • PubMatic
  • Full time
  • Others
  • 11/20/2026
  • Pune, India