Senior Software Engineer, Data Platform

Home > Python programming jobs

Senior Software Engineer, Data Platform in USA

Harvey
Full time
Email

USA
08/26/2026
Report

San Francisco, CA

Responsibilities

Own the data platform architecture and technical direction, including reusable frameworks and build-versus-buy decisions.
Build and operate ingestion across streaming, batch, CDC, and third-party connectors with safe schema evolution.
Land data in Snowflake with reliable freshness, completeness, and cost characteristics and define handoffs to Analytics Engineering.
Own orchestration capabilities including scheduling, retries, backfills, and dependency management.
Build transformation, compute, stream-processing, and self-serve pipeline frameworks for product engineers, data engineers, and analysts.
Develop data quality, observability, lineage, cataloging, discovery, alerting, and anomaly-detection capabilities.
Create tooling for PII classification, masking, retention, access control, and multi-region data residency.
Set technical standards through design reviews, documentation, and mentorship while helping build the data platform team.

Requirements

5+ years of experience building and operating production data infrastructure that other teams depend on.
Deep experience with cloud data warehouses, especially Snowflake, including performance tuning and cost management.
Hands-on experience building CDC and streaming pipelines with technologies such as Kafka, Debezium, Flink, or Spark Streaming.
Experience with managed ingestion tools such as Fivetran or Airbyte and sound build-versus-buy judgment.
Strong experience operating workflow orchestration platforms such as Temporal, Airflow, or Dagster at scale.
Strong Python programming skills and advanced SQL proficiency.
Experience building frameworks or internal tools used by other engineers.
Practical experience with data quality, observability, lineage, and schema evolution for high-availability systems.
Working knowledge of data governance in regulated environments, including PII classification, masking, access control, retention, and data residency.
Familiarity with Azure, AWS, GCP, Kubernetes, and infrastructure-as-code tools such as Terraform or Pulumi.
Preferred: experience with dbt, lakehouse architectures, Iceberg, Delta Lake, Trino, multi-tenant secure platforms, AI-product data infrastructure, or early/founding data platform roles.

Benefits

The role is based in San Francisco, CA or New York, NY.
The position offers the opportunity to be an early hire on the central data platform team and help shape its technical direction and team.
Compensation is listed separately as a base salary range of $193,400–$290,000 USD.

Salary: $193k - $290k/yr

Harvey

Harvey is domain-specific AI for legal and professional services. Adopted by Fortune 500 companies like AT&T, Verizon, Cox, Koch, KKR, Bridgewater, more than 100,000 lawyers across 2,400+ customers in 70 countries and over 75% of AmLaw 100 law firms rely on Harvey to advance legal expertise faste...

Similar positions

Senior Software Engineer - Machine Learning

Anduril Industries
Full time

USA
10/25/2026
Salary: $190k - $252k/yr

Broomfield, CO

2027 Software Engineer

Point72
Full time

Others
10/25/2026

Bengaluru, India

Platform Engineer

Quindar
Full time

USA
10/25/2026
Salary: $145k - $186k/yr

Washington, DC

Senior Machine Learning Engineer

Spotify
Full time

Remote
10/25/2026
Salary: $184k-$263k

North America

Staff Software Engineer | AI

LawPay
Full time

Remote
10/25/2026
Salary: $150k-$190k

United States