Be wary of WhatsApp messages impersonating Jobline Resources's staff offering job opportunities. Those who encounter suspicious messages can contact Jobline at +65 6339 7198

Responsibilities

  • To support the Human-Centered AI (HAI) Quality Evaluation team in Singapore.
  • Drive programs focused on quality evaluation of Generative AI (GenAI) experiences, working with researchers, engineers, platform teams, and cross-functional stakeholders to build scalable evaluation capabilities.
  • Manage platform and tooling dependencies, translating evaluation requirements into technical needs, aligning priorities and roadmaps, and driving blockers to resolution. 
  • Support geo-expansion for Market Intelligence and Content Enrichment, coordinating evaluation readiness across new markets, languages, and regions.
  • Drive HAI Quality Evaluation programs, including planning, roadmaps, priorities, milestones, dependencies, risks, and readiness.
  • Translate research and evaluation objectives into clear execution plans.
  • Manage platform and tooling dependencies and drive gaps or blockers to resolution.
  • Align Quality Evaluation requirements with platform and engineering roadmaps.
  • Drive geo-expansion for Market Intelligence and Content Enrichment across research, engineering, evaluation, platform, and regional teams.
  • Support scalable GenAI evaluation across markets, languages, and locales.
  • Partner with researchers on evaluation methodologies, metrics, datasets, and quality criteria.
  • Track evaluation/platform readiness, risks, dependencies, and overall program health.
  • Drive cross-functional alignment, decisions, ownership, and accountability.
  • Communicate program status, priorities, risks, and technical dependencies to teams and leadership.

Requirements

  • Bachelor’s degree or equivalent experience in Computer Science, Engineering, Data Science, or related field.
  • 5+ years in engineering/technical program management, product management, or similar technical roles.
  • Experience with AI/ML, GenAI, research, evaluation, or data-focused engineering teams.
  • Experience managing technical roadmaps, priorities, and platform/infrastructure/tooling dependencies.
  • Technical fluency to work effectively with researchers and engineers and understand system dependencies, constraints, and tradeoffs
  • Strong cross-functional leadership and ability to influence without direct authority.
  • Ability to navigate ambiguity and convert complex problems into actionable plans.
  • Strong communication, analytical, and problem-solving skills.
  • Experience working with globally distributed teams.

Good to Have
  • Experience with GenAI/LLM evaluation, including human or automated evaluation.
  • Knowledge of quality metrics, evaluation datasets, model comparison, and launch readiness.
  • Experience with AI/ML or evaluation platforms and developer tooling.
  • Experience with internationalization, localization, or geo-expansion, particularly in APAC.
  • Experience supporting launches across multiple languages, locales, and markets.
  • Exposure to Market Intelligence, content understanding, or content enrichment.
  • Understanding of the ML lifecycle from data/model development through evaluation, launch, and monitoring.
  • Experience defining quality gates, evaluation thresholds, and go/no-go criteria.
  • Experience moving AI/ML capabilities from research into scalable production environments.

Location: Singapore, collaborating with HAI and cross-functional teams across global time zones.

Shortlisted candidates will be offered a 1 Year Agency Contract employment