Your browser does not support javascript! Please enable it, otherwise web will not work for you.

LLM Engineer (Data Generation)

Home > Python programming jobs

LLM Engineer (Data Generation) in Others new

  • Sŏngnam, Korea

Responsibilities

  • Analyze model performance bottlenecks, failure cases, and training objectives with Research and Model Training teams to define data requirements.
  • Design, generate, refine, and curate instruction, preference, reasoning, domain-specific, and synthetic training data.
  • Build and operate automated data-generation pipelines and large-scale data-production workflows.
  • Optimize data pipelines for generation cost, processing speed, reliability, and quality.
  • Define quantitative and qualitative data-quality and training-effectiveness evaluation criteria.
  • Use LLM-as-a-Judge, rule-based validation, and human feedback to evaluate generated data.
  • Develop iterative generation, filtering, and data-improvement strategies based on experimental results.

Requirements

  • At least 3 years of professional experience related to LLMs, machine learning, or data generation.
  • Broad understanding of deep learning, machine learning, and natural language processing.
  • Understanding of training-data composition, preprocessing, quality evaluation, and incorporation into model training.
  • Ability to develop Python-based data processing and automation systems.
  • Experience processing, refining, filtering, and managing the quality of large-scale training datasets, or equivalent capability.
  • Experience generating synthetic data with LLMs, evaluating data, or curating data.
  • Understanding or practical experience with LLM APIs and prompting or generation strategies.
  • Strong problem-solving, collaboration, and communication skills.
  • Preferred: experience building large-scale LLM training datasets for pre-training, supervised fine-tuning, DPO, RLHF, or RLAIF.
  • Preferred: experience with OpenAI Evals, LM Evaluation Harness, DeepEval, or a proprietary LLM evaluation system.
  • Preferred: experience designing advanced LLM data for multi-turn dialogue, tool calling, agents, reasoning, or code generation.
  • Preferred: experience building Python data pipelines or large-scale data-processing environments with Airflow, Ray, or Spark.
  • Preferred: contributions to open-source Generative AI, LLM, or NLP projects, or publications and technical presentations.

Benefits

  • The hiring process includes application review, a coding or assignment test, two interviews, and offer discussions; the process may change depending on scheduling and progress.
  • Interviews may be conducted by video or in person.
  • A three-month probationary period may apply.
  • National merit and employment-protection beneficiaries receive preference under applicable law.
  • Registered persons with disabilities receive preference under applicable law.

42dot

42dot builds software-defined vehicle and autonomous mobility platforms for automakers and mobility service providers. Its products include AI-driven vehicle software, data-based update services, and core platform components such as API gateways and identity/access management to connect services ...

Similar positions

AI/ML Engineer

  • DeepIntent
  • Full time
  • Others
  • 11/20/2026
  • Pune, India

Senior Security Engineer

  • Shiftsmart
  • Full time
  • USA
  • 11/20/2026
  • Salary: $155k - $220k/yr
  • New York, NY

Engineer Sr Analyst - C12 - PUNE

  • Citi
  • Full time
  • Others
  • 11/20/2026
  • Pune, India

Senior Data Engineer - Knowledge Ingestion

  • Solvd
  • Full time
  • Remote
  • 11/20/2026
  • US

Principal Engineer - Machine Learning Platform

  • PubMatic
  • Full time
  • Others
  • 11/20/2026
  • Pune, India