Software Engineer, Agent Optimization & Evaluation

Home > Other programming jobs

Software Engineer, Agent Optimization & Evaluation in USA

Reddit
Full time
Email

USA
10/20/2026
Report

Remote

Responsibilities

Design and build an optimization harness for evaluating, benchmarking, and improving AI agents across software engineering workflows.
Develop Reddit-specific evaluation environments for measuring agent performance on meaningful engineering tasks.
Build systems for offline replay, automated evaluation, synthetic task generation, regression detection, and human-in-the-loop feedback.
Design model routing and orchestration strategies optimized for quality, latency, reliability, and cost.
Define metrics and experimentation frameworks measuring developer productivity and engineering velocity.
Build tooling to analyze agent behavior, investigate failures, and accelerate iteration.
Partner with Platform Engineering, Infrastructure, and Developer Productivity teams to integrate agent capabilities into engineering workflows.
Help shape Reddit’s flexible, model-agnostic agent platform strategy.

Requirements

5–12+ years of engineering experience.
Extensive experience building and shipping large-scale production software systems.
Experience designing evaluation, experimentation, benchmarking, or measurement systems for AI, search, developer platforms, or complex distributed systems.
Strong understanding of modern LLMs, AI agents, and the engineering systems required to deploy them effectively.
Experience optimizing systems across quality, latency, reliability, and cost.
Strong software engineering fundamentals and a commitment to production-quality systems.
Ability to work independently in ambiguous environments and drive technical direction for strategic initiatives.
Strong cross-functional collaboration skills across engineering, infrastructure, and platform organizations.

Benefits

Comprehensive healthcare benefits and income replacement programs.
401(k) with employer match.
Global benefits supporting workspace, professional development, and caregiving.
Family planning support.
Gender-affirming care.
Mental health and coaching benefits.
Flexible vacation and paid volunteer time off.
Generous paid parental leave.
US-based employees receive medical, dental, and vision insurance and additional vacation and parental leave benefits.
The role may be eligible for restricted stock units and, depending on the position offered, commission.
The posting may span more than one career level.
Some interviews may be recorded, transcribed, and summarized by AI, with an option to opt out.

Salary: $110k - $325k/yr

Reddit is a network of communities where people can delve into their interests, hobbies, and passions. There's a community for whatever you're interested in. You can post – the community can share content by posting stories, links, images and videos. You can comment on posts. You can vote – comme...

Similar positions

Senior Software QA Engineer

Epiq
Full time

Others
10/25/2026

Pune, India

Senior Security Engineer, AM/CIAM

GuidePoint Security
Full time

USA
10/25/2026

Remote

Agentic AI Forward Deployment Engineering

Netomi
Full time

Canada
10/25/2026

Remote

Principal Software Engineer

CaptivateIQ
Full time

Remote
10/25/2026

Poland

Senior Engineer, Cybersecurity (R6438)

Shield AI
Full time

USA
10/25/2026
Salary: $142k - $213k/yr

Seattle, WA