Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Cyber Evaluations Engineer

Home > Python programming jobs

Cyber Evaluations Engineer in USA

  • Anthropic
  • Full time
  • Email
  • Washington, DC

Responsibilities

  • Design and run capability, uplift, and safety evaluations for cyber-relevant model risks.
  • Execute safeguard-robustness testing before major model releases.
  • Analyze evaluation results and communicate findings to teams and stakeholders.
  • Design, prototype, and tune detection probes for cyber misuse.
  • Partner with cyber policy and engineering teams to translate policy lines into layered abuse-detection architecture and measure precision and coverage.
  • Build and maintain internal tooling for running and scoring evaluations.
  • Collaborate on converting evaluation findings into safeguard improvements.

Requirements

  • Experience building or running evaluations, benchmarks, or test suites for software or ML systems on short, fixed timelines.
  • Hands-on cybersecurity experience such as CTF participation, vulnerability research, exploit development, or security research.
  • Proficiency in Python.
  • Strong ability to communicate evaluation results with cross-functional and policy stakeholders.
  • Bachelor’s degree in a relevant field or an equivalent combination of education, training, and experience.
  • Preferred qualifications include deep offensive-security or security-research experience, AI security benchmark development, adversarial or abuse-data analysis, AI/ML evaluation frameworks, coordinated vulnerability disclosure, pre-release testing, detection-content authoring, ML-based abuse detection, and an active secret clearance or eligibility to obtain one.

Benefits

  • Hybrid work with staff expected to be in an Anthropic office at least 25% of the time, with some roles requiring more office time.
  • Visa sponsorship may be available, with immigration-lawyer support.
  • Competitive benefits, flexible working hours, generous vacation and parental leave, optional equity donation matching, and office collaboration space.

Salary: $300k - $405k/yr

Anthropic

Anthropic builds AI systems that are reliable, interpretable, and steerable, with a commitment to ensuring their safety and benefit to users and society. Our work is driven by a dedicated team of researchers, engineers, and policy experts focused on the development of beneficial AI solutions.

Similar positions

Graduate Software Engineer

  • Synack
  • Full time
  • UK
  • 10/04/2026
  • Remote

Software Engineer - Cloud Images

  • Canonical
  • Full time
  • Remote
  • 10/04/2026
  • EMEA, Americas

GTM Engineer

  • Higgsfield
  • Full time
  • USA
  • 10/04/2026
  • Salary: $130k - $175k/yr
  • San Francisco, CA

Research Engineer

  • Clera
  • Full time
  • Others
  • 10/04/2026
  • Zürich, Switzerland

Lead Automation Quality Engineer

  • London Stock Exchange Group
  • Full time
  • Others
  • 10/04/2026
  • Salary: Competitive
  • Bengaluru, India