Software Engineer, Big Data

Home > Other programming jobs

Software Engineer, Big Data in USA new

ZipRecruiter
Full time
Email

USA
11/03/2026
Report

Santa Monica, CA

Responsibilities

Design, build, deploy, and maintain data pipelines and systems that ingest web events into data lakes and event streams.
Develop batch and streaming big-data processing systems for large, evolving datasets.
Build and operate MLOps frameworks that improve the velocity, quality, observability, and reliability of ML development and ML-powered products.
Create frameworks and tooling that improve data documentation quality, maintenance, and discoverability.
Build and maintain Sift, an agentic data exploration and analysis tool.
Develop infrastructure and tools for streaming and batch ingestion, ETL pipelines, data permissions, and data discovery.

Requirements

At least 2 years of professional software development experience, including building and operating data pipelines that feed customer-facing products.
Hands-on Apache Spark experience writing, tuning, and debugging batch or streaming jobs at scale.
Experience deploying and operating containerized services and batch jobs.
Strong computer science fundamentals in data structures, algorithms, distributed systems, and testing.
Preferred: 4+ years of professional software development experience focused on data-intensive systems.
Preferred: working knowledge of AWS services including S3, IAM, EC2, and MSK or equivalents, plus job instrumentation with metrics, logs, and alerts.
Preferred: experience with data lakes, Parquet, AWS Glue, Apache Iceberg or Delta Lake, Kafka, Apache Flink, Spark Structured Streaming, and Apache Airflow.
Preferred: experience deploying services on Kubernetes with Docker and maintaining data platforms for user-facing products.
BS, MS, or PhD in Computer Science, Mathematics, Physics, or a related field, or equivalent practical experience.

Benefits

Hybrid work environment; most US-based positions can be performed remotely unless otherwise noted.
Competitive compensation.
Exceptional benefits package.
Flexible vacation and paid time off.
Employer-matched 401(k) plan.

Salary: $135k - $185k/yr

ZipRecruiter

ZipRecruiter builds an online employment marketplace used by businesses to advertise jobs and by job seekers to find and apply, powered by AI-based matching. The company sells recruiting and job advertising tools to employers through subscriptions and performance-based options, with free tools fo...

Similar positions

PhD Intern, Software Engineer

Figma
Full time

USA
11/04/2026

San Francisco, CA

Database Platform Engineer

University of Auckland
Full time

Others
11/04/2026

Auckland, New Zealand

Sr Software Engineer - Engineer

Uber
Full time

Others
11/04/2026

Bengaluru, India

Senior Software Engineer, Big Data

ZipRecruiter
Full time

USA
11/04/2026
Salary: $190k - $250k/yr

Remote

Software Engineer (Portugal)

HiddenLayer
Full time

Others
11/04/2026

Lisbon, Portugal