Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior Software Engineer II

Home > Python programming jobs

Senior Software Engineer II in USA

  • Instacart
  • Full time
  • Email
  • Remote

Responsibilities

  • Design, develop, and deploy machine learning infrastructure for ads training and serving systems.
  • Optimize training and serving throughput, cost, latency, GPU and accelerator utilization, and tail latency.
  • Build real-time feature processing infrastructure, including low-latency pipelines, online feature stores, and streaming update paths.
  • Lead infrastructure for a real-time sequential foundation model, including long-context serving and evolving-data training pipelines.
  • Collaborate with product managers, data scientists, machine learning engineers, and the ML Foundation team to co-design systems.
  • Identify system and operational shortcomings to improve availability and stability.
  • Mentor engineers, set technical direction, and conduct code reviews.

Requirements

  • Master’s or PhD in computer science, artificial intelligence, machine learning, operations research, or equivalent self-study and experience.
  • At least 3 years of industry experience building ML infrastructure or applying machine learning to real-world problems with large datasets.
  • Deep expertise building, scaling, and managing production ML infrastructure for training and/or serving, with strong MLOps knowledge.
  • Strong software engineering skills, such as Python or Go, plus experience with SQL, Spark, Pandas, Torch, TensorFlow, and XGBoost.
  • Strong analytical, problem-solving, communication, and cross-functional collaboration skills.
  • Preferred: 5+ years of industry experience technically leading teams building ML infrastructure or solving machine learning problems.
  • Preferred: experience with training and serving efficiency, real-time feature processing, Kafka, Flink, online feature stores, low-latency retrieval, sequential modeling, transformer architecture, recommendation systems, large foundation models, digital advertising platforms, LLM integrations, prompt engineering, and productivity tooling.

Benefits

  • Flex First remote work arrangement, allowing employees to work from home, an office, or another preferred location, with regular in-person events.
  • Market-competitive location-based base compensation.
  • Eligible for a new hire equity grant and annual refresh grants.
  • Benefits offerings are available; details are provided through the company benefits materials.

Salary: $192k - $243k/yr

Instacart

Instacart is a leading grocery technology company that partners with more than 2,200 retail banners – representing nearly 100,000 stores – to transform how people shop for the groceries they need from the retailers they trust, while creating flexible earning opportunities for shoppers. Through th...

Similar positions

Backend Engineer (Europe)

  • Kalepa
  • Full time
  • Remote
  • 10/26/2026
  • Salary: $80k-$105k
  • Europe

Sr. AI/ML Engineer II

  • MetroStar
  • Full time
  • USA
  • 10/26/2026
  • Salary: $200k - $240k/yr
  • Reston, VA

Staff Security Engineer

  • Quince
  • Full time
  • Others
  • 10/26/2026
  • Bengaluru, India

ChatGPT Performance Engineer

  • OpenAI
  • Full time
  • USA
  • 10/26/2026
  • Salary: $325k-$405k
  • Remote

Junior Backend Engineer (Europe)

  • Kalepa
  • Full time
  • Remote
  • 10/25/2026
  • Salary: $60k-$70k
  • Europe