Software Test Engineer

Home > Python programming jobs

Software Test Engineer in Remote

Deepgram
Full time
Email

Remote
08/28/2026
Report

Worldwide

Responsibilities

Define and execute test plans across products, APIs, SDKs, model-powered features, and data platforms.
Build and maintain automated test suites and frameworks for functional, integration, end-to-end, regression, API, browser, and service-level testing.
Translate requirements and customer acceptance criteria into test strategies, test cases, and release gates.
Create customer-focused and adversarial datasets, fixtures, and test environments covering edge cases, failure modes, and system limits.
Evaluate speech-to-text, text-to-speech, and other AI behavior using metrics, expected outputs, human review, and regression coverage.
Build test harnesses, reusable scripts, test-data tooling, result-aggregation pipelines, dashboards, and visualizations.
Integrate automated tests, quality checks, canaries, and release validation into continuous integration and deployment workflows.
Test data ingestion, processing, annotation, quality control, integrity, completeness, deduplication, leakage, and downstream readiness.
Perform staging and production validation, load and reliability testing, cross-browser testing, customer-workflow testing, and user acceptance testing.
Maintain test cases, automation coverage, documentation, and release-readiness reporting.
Write reproducible bug reports with inputs, parameters, expected and actual results, logs or artifacts, and severity.
Contribute to code reviews, test-design reviews, technical discussions, and engineering and QA practice improvements.

Requirements

Bachelor's, master's, or doctoral degree in Computer Science, AI, Applied Mathematics, or a related field, or equivalent experience.
At least 5 years of professional software or QA engineering experience, including shipping test infrastructure or evaluation systems.
Backend or scripting experience in Python, Rust, Go, or a similar language.
Experience designing and building automated test pipelines, evaluation frameworks, or data-processing systems.
Strong analytical skills and comfort reasoning about metrics, thresholds, and statistical variation.
Ability to take ownership of ambiguous technical challenges and communicate across research, engineering, and product teams.
Preferred experience testing LLMs, RAG pipelines, agents, or multimodal models.
Preferred experience with voice, audio, speech recognition, or real-time systems and metrics such as WER, MOS, latency, and time-to-first-byte.
Preferred experience building test, evaluation, benchmarking, or ML infrastructure used by multiple teams or external users.
Preferred experience with React Native, mobile applications, cloud infrastructure, containers, ephemeral test environments, monitoring tools, open-source projects, or cross-team technical bridging.

Salary: $150k - $220k/yr

Deepgram

Deepgram is the real-time API platform powering the trillion-dollar Voice AI economy. Backed by a $130M Series C at a $1.3B valuation, Deepgram is trusted by 200,000+ developers and 1,300+ organizations to build Voice AI products, platforms, and autonomous agents with the lowest latency, highest ...

Similar positions

Quantitative Software Engineer (DV Commodities)

DV Trading
Full time

UK
10/15/2026

London

Full-Stack Engineer - Payments Engineering

ElevenLabs
Full time

Remote
10/15/2026

Europe, Ireland

GIS Developer / Application Engineer

Ardent
Full time

USA
10/15/2026
Salary: Competitive

Remote

Senior Software Engineer, Platform

Astronomer
Full time

Remote
10/15/2026
Salary: EUR 105,000 - 175,000

Europe, Ireland

Safety Engineer (Back-End Leaning)

ElevenLabs
Full time

Others
10/15/2026

Dublin, Ireland