Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Research Engineer - Multimodal Training Infrastruc

Home > Other programming jobs

Research Engineer - Multimodal Training Infrastruc in USA

  • ByteDance
  • Full time
  • Email
  • San Jose, CA

Responsibilities

  • Conduct research and development on large-scale infrastructure for training foundation models, multimodal LLMs, and image/video generation models.
  • Design and optimize distributed training strategies, including data, model, pipeline, and expert parallelism.
  • Improve computation, communication, throughput, networking, scheduling, and GPU memory management across the training stack.
  • Research reliability and resilience techniques including fast checkpointing, fault tolerance, and failure diagnosis.
  • Analyze performance bottlenecks in exascale training systems and develop data-driven optimization methods.
  • Translate research ideas into scalable, production-ready infrastructure solutions.

Requirements

  • Deep expertise in large-scale distributed training of LLMs and multimodal models.
  • Strong systems research background with demonstrated ability to design, build, and optimize large-scale ML systems.
  • Proven experience with data, model, pipeline, and expert parallelism and performance optimization on large GPU clusters.
  • Strong programming skills and hands-on experience implementing production-grade ML systems or infrastructure.
  • Solid understanding of algorithm–system co-design and cross-layer optimization for training efficiency, scalability, and reliability.

ByteDance

ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This...

Similar positions

Senior Devops Engineer

  • Lloyds Banking Group
  • Full time
  • Others
  • 11/20/2026
  • Hyderābād, India

Senior Software Engineer, Model Evaluation

  • Clera
  • Full time
  • USA
  • 11/20/2026
  • Salary: $180k - $250k/yr
  • San Francisco, CA

Staff AI Engineer, Internal Tools

  • RVO Health
  • Full time
  • Remote
  • 11/20/2026
  • Salary: $170k-$200k
  • United States

Senior Analytics Engineer

  • Air New Zealand
  • Full time
  • Others
  • 11/20/2026
  • Auckland, New Zealand

Sr. DevSecOps Engineer I (6724)

  • MetroStar
  • Full time
  • USA
  • 11/20/2026
  • Salary: $200k - $220k/yr
  • Reston, VA