Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior QA Analyst / Tester

Home > Python programming jobs

Senior QA Analyst / Tester in USA

  • Orion Innovation
  • Full time
  • Email
  • Remote

Responsibilities

  • Design and execute adversarial testing campaigns against large language models, multimodal systems, and autonomous agents.
  • Research attack vectors, prompt injection techniques, model vulnerabilities, jailbreaks, and unintended behaviors.
  • Conduct red team exercises covering deployment scenarios and edge cases, including testing for bias, toxicity, misinformation, and other harmful outputs.
  • Evaluate and introduce AI security tools to reduce detection and response time for AI-specific threats.
  • Create adversarial datasets and benchmarks to evaluate model robustness under attack conditions.
  • Collaborate with security teams and developers to conduct red teaming activities and improve the organization’s security posture.
  • Document and present vulnerabilities, findings, risks, and remediation recommendations.
  • Maintain process documentation, produce testing reports, track operational metrics, and support other AI Red Team program activities.

Requirements

  • Minimum five years of penetration testing, red team operations, or AI Red Team experience.
  • Bachelor's or higher degree in computer science, information technology, programming, development, artificial intelligence, or cybersecurity, or equivalent work experience.
  • Background in AI red teaming, red teaming, or offensive cyber operations.
  • Understanding of artificial intelligence, machine learning, software applications, cloud computing, and networking.
  • Experience with relevant testing and security tools such as SPLX, Garak, TextAttack, PyRIT, Burp Suite, Metasploit, Nessus, Cobalt Strike, Mythic, Nmap, and sqlmap, or similar tools.
  • Knowledge of web application technologies and Layer 7 protocols including HTTP, DNS, and FTP.
  • Technical knowledge of Generative AI, Agentic AI, A2A, and/or MCP.
  • Programming experience with Python, Ruby, Go, C++, PowerShell, bash, or similar languages.
  • Relevant AI red team or security certifications such as OSCP, GPEN, GPXN, AI Teamer Job Role Path, AISEC+, GASAE, GOAA, or OSAI+ is desired.
  • Strong communication and stakeholder management skills, with the ability to work across geographies and time zones.

Orion Innovation

Orion Innovation delivers next-generation solutions in Data, AI, Cloud, and Digital Experience, empowering organizations to innovate, scale, and embrace future technologies. With deep software engineering expertise and a strong understanding of industry-specific challenges, we build data-driven p...

Similar positions

Senior Backend Engineer - Client integrations

  • Kalepa
  • Full time
  • Remote
  • 10/04/2026
  • Salary: $80k-$165k
  • Europe

Senior Software Engineer

  • Muon Space
  • Full time
  • USA
  • 10/04/2026
  • Salary: $192k - $213k/yr
  • Denver, CO

Senior Principal Autonomy Engineer (R6162)

  • Shield AI
  • Full time
  • USA
  • 10/04/2026
  • Salary: $330k - $500k/yr
  • Remote

Senior Software Engineer

  • Mozilla
  • Full time
  • UK
  • 10/04/2026
  • Salary: £65k-£87k
  • Remote

Senior AI ML Engineer

  • Viatris
  • Full time
  • Others
  • 10/04/2026
  • Bengaluru, India