About the role and team

The Program Manager, Tech leads complex programs that bridge technical vision and operational execution. This role focuses on the "how" of technical delivery—scaling systems like AI/ML human-in-the-loop workflows or global supply chains by navigating high-ambiguity environments and maintaining disciplined operational excellence.

Rate of Pay: $135,000.00 to $165,000.00 per Year

You will be eligible to participate in Uber's bonus program, and may be offered other types of comp. You will also be eligible for various benefits. More details can be found at the following link https://www.uber.com/careers/benefits.

What You’ll Do

• Technical program manager managing GenAI programs.
• Design and implement comprehensive MT and LLM programs that support both Uber's internal operations and external clients. This includes architecting Reinforcement Learning from AI Feedback (RLAIF) frameworks to scale model alignment and ensure consistency with our global communication and localization strategies.
• Build seamless integration points between Uber's internal services and tools, connecting them to our MT/LLM pipeline.
• Serve as a technical liaison—utilizing Python scripting to automate data flows—and optimize the pipeline for efficiency, specifically regarding the deployment of LLM-as-a-Judge for automated quality gatekeeping.
• Partner with the Localization Operations (LocOps) and Language Model Engineering teams to select, evaluate, train, and deploy the most effective models.
• Leverage Python to develop and run LLM-based evaluation rubrics that act as a judge for model performance, aiming to enhance both internal productivity and external localization outcomes.
• Lead cross-functional initiatives and engage with internal localization teams and external partners. This includes gathering requirements, drafting Product Requirement Documents (PRDs) for RLAIF pipelines, and managing the execution of tool enhancements and process improvements.
• May telecommute.
  

Basic Qualifications

• Employer will accept a Master's degree in Porgram Management, Computer Science, Information Management, or related field, and 6 months of experience in the job offered or in a related occupation.
• Position requires:
  • Large Language Models (LLMs) and Prompt Engineering; demonstrated experience implementing Reinforcement Learning from AI Feedback (RLAIF) or Human Feedback (RLHF) to scale model alignment;
  • Experience fine-tuning and deploying production-grade LLMs or MT models (such as GPT, Mistral, T5, or OpenNMT) within scalable enterprise environments;
  • Ability to design and architect automated evaluation pipelines, specifically utilizing "LLM-as-a-Judge" frameworks to optimize AI-assisted translation and human-in-the-loop (HITL) workflows;
  • LLMOps/MLOps role, including the review of architecture diagrams, API documentation, and the monitoring of model lifecycle management and deployment performance;
  • Leading cross-functional AI/ML initiatives by translating complex business requirements into technical Product Requirement Documents (PRDs) for engineering and product teams;
  • Python scripting for data flow automation and SQL for analyzing judge-based quality metrics and reinforcement learning progress;
  • Understanding of data privacy, redaction layers, and secure model access protocols within enterprise GenAI environments to ensure compliance with global data protection regulations;
  • Experience curating instruction-tuning datasets and utilizing LLMs for synthetic data generation to improve dataset diversity for model alignment training.

Ready to Ride?