Senior Principal AI/ML Architect - Yahoo Mail

Yahoo

  • Remote - US
  • Hybrid
  • Staff/Principal level
  • 12+ yrs experience
  • AI/ML Architecture & Engineering
  • Visa: not specified
  • $161k–$350k

The role in 30 seconds

Yahoo Mail is a consumer inbox serving hundreds of millions of users, and the Mail Intelligence AI/ML Platform powers intelligent capabilities across the ecosystem. This role defines and drives the architectural vision for agentic, assistive, and personalization intelligence at business-unit scale, setting AI strategy, architecture patterns, evaluation standards, and operational excellence for intelligent systems operating at global scale.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • B2C consumer-facing application
  • Marketplace / multi-sided platform
  • Data platform / ML pipeline
  • Consumer / general public
  • SMB / small business

Workable stretch

  • B2B enterprise platform / workflow software
  • Creator / builder / self-serve tool
  • Enterprise users
  • Developers / technical users
  • Regulated environment (healthcare, finance, government)

Harder transition

  • Internal tooling / back-office systems
  • Embedded systems / hardware-adjacent
  • Internal users (employees, ops teams)
  • Startup / greenfield (build from scratch, speed over polish)

Industry: Software, SaaS & AI Platform (consumer email/messaging). See your personal match score

What they're really screening for

Must-haves

  • PLUS Bachelor's or Master's degree in Computer Science or related discipline; or equivalent experience
  • CORE 12+ years of software engineering experience
  • CORE Deep AI/ML expertise
  • CORE Proven track record architecting large-scale AI platforms
  • CORE Expertise in distributed ML systems
  • CORE Expertise in LLMs and generative AI
  • CORE Expertise in personalization and ranking systems
  • CORE Expertise in production inference infrastructure
  • PLUS Experience influencing architecture across multiple teams or business units
  • PLUS Demonstrated ability to translate business strategy into technical strategy

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • AI/ML
  • LLMs
  • Generative AI
  • Multi-agent systems
  • LLM orchestration
  • Retrieval + reasoning
  • Personalization
  • Ranking systems
  • Recommendation systems
  • Model serving
  • Inference infrastructure
  • ML lifecycle governance
  • MLOps
  • Distributed ML systems
  • Agentic AI

Concepts & phrases

  • Senior Principal AI/ML Architect
  • agentic, assistive, and personalization intelligence
  • Multi-agent systems
  • Tool-augmented LLM orchestration
  • Memory and context frameworks
  • Retrieval + reasoning hybrid architectures
  • responsible AI standards
  • human-in-the-loop and autonomy control patterns
  • Unified user representation
  • Cross-product intelligence graph
  • Real-time ranking and recommendation systems
  • Model serving standardization
  • LLM hosting strategy
  • Cost optimization and latency budgets
  • Cross-team reusable AI infrastructure

Words that count as the same thing: "LLMs" ≈ Large Language Models, Large Language Model systems, Generative AI models · "Agentic AI" ≈ Autonomous AI agents, Multi-agent systems, Tool-augmented LLM orchestration · "Personalization" ≈ Recommendation systems, Ranking systems, User modeling · "Inference infrastructure" ≈ Model serving, ML serving infrastructure, Production inference · "ML lifecycle governance" ≈ MLOps, ML governance, Model lifecycle management

Check my résumé against these keywords

Hiring at Yahoo

All Yahoo hiring data

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at Yahoo

Full job description from Yahoo

From Yahoo's posting. View the original

Yahoo Mail is the ultimate consumer inbox with hundreds of millions of users. It’s the best way to access your email and stay organized from a computer, phone or tablet. With its beautiful design and lightning fast speed, Yahoo Mail makes reading, organizing, and sending emails easier than ever.

A Little About Us

Yahoo Mail serves over 220M users globally and operates at massive scale—billions of inbound connections and trillions of messages. Our vision is to be the best consumer inbox that helps users run the business of their lives.

Show full description Show less

The Mail Intelligence AI/ML Platform powers intelligent capabilities across Yahoo Mail and the broader Yahoo ecosystem. We build systems that extract meaning from unstructured content, understand user context and intent, and deeply personalize user journeys at scale.

We are evolving beyond traditional ML into agentic, assistive, and proactive intelligence—systems that don’t just classify or recommend, but reason, act, orchestrate workflows, and assist users autonomously and responsibly.

A Lot About You

We are seeking a Senior Principal AI/ML Architect (IC6) to define and drive the architectural vision for agentic, assistive, and personalization intelligence across Yahoo Mail and adjacent Yahoo properties. As the AI/ML Architect scope spans business-unit level impact, with influence across multiple squads and strategic alignment with business direction. You will define long-term AI strategy, architecture patterns, evaluation standards, and operational excellence for intelligent systems that operate at global scale.

• Lead architecture for mission-critical AI systems across the business unit

• Translate ambiguous business opportunities into cohesive AI platform strategy

• Influence technical direction across multiple squads

• Set engineering and operational standards at the business unit level

• Proactively align design choices with long-term business strategy

What You’ll Drive

Agentic AI Architecture Strategy

• Define reference architectures for:

• Multi-agent systems

• Tool-augmented LLM orchestration

• Memory and context frameworks

• Retrieval + reasoning hybrid architectures

• Establish guardrails, explainability, and responsible AI standards.

• Design human-in-the-loop and autonomy control patterns.

Personalization Platform Evolution

• Define next-gen personalization architecture:

• Unified user representation

• Cross-product intelligence graph

• Real-time ranking and recommendation systems

• Set metrics frameworks and benchmarking standards for personalization quality.

Inference & ML Platform Modernization

• Lead architectural decisions on:

• Model serving standardization

• LLM hosting strategy (self-hosted vs API)

• Cost optimization and latency budgets

• Cross-team reusable AI infrastructure

• Drive build-vs-buy decisions at business-unit scale .

Governance & Engineering Excellence

• Set engineering standards across BU .

• Define evaluation frameworks for LLM and ML quality.

• Establish reproducibility, experimentation, and ML lifecycle governance.

• Champion tech initiatives to scale quality and communication .

Organizational & External Influence

• Lead cross-functional alignment (Product, Data Science, Infra).

• Mentor principal and senior engineers.

• Represent Yahoo engineering externally via talks, blogs, and technical leadership .

• Shape industry best practices in assistive and agentic AI systems.

Qualifications

• Bachelor's degree or Master's degree in Computer Science or related discipline; or equivalent experience

• 12+ years of software engineering experience, with deep AI/ML expertise

• Proven track record architecting large-scale AI platforms

• Strong expertise in:

• Distributed ML systems

• LLMs and generative AI

• Personalization and ranking systems

• Production inference infrastructure

• Experience influencing architecture across multiple teams or business units

• Demonstrated ability to translate business strategy into technical strategy

The material job duties and responsibilities of this role include those listed above as well as adhering to Yahoo policies; exercising sound judgment; working effectively, safely and inclusively with others; exhibiting trustworthiness and meeting expectations; and safeguarding business operations and brand integrity.

At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don’t require regular office attendance, you may occasionally be asked to attend in-person events or team sessions. You’ll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, just ask the recruiter!

Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider for employment qualified applicants with criminal histories in a manner consistent with applicable law. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form (www.yahooinc.com/careers/contact-us.html) or call +1.866.772.3182. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.

We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome.

The compensation for this position ranges from $160,965.00 - $349,885.00/yr and will vary depending on factors such as your location, skills and experience.The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions. Our comprehensive benefits include healthcare, a great 401k, backup childcare, education stipends and much (much) more.

Currently work for Yahoo? Please apply on our internal career site.

FAQ

How much does a Senior Principal AI/ML Architect - Yahoo Mail at Yahoo make?

The posted pay for this role is $161k–$350k a year.

How much experience do you need?

The posting asks for 12+ years in software engineering with ai/ml expertise. It is a staff/principal-level role.

Does Yahoo sponsor visas for this role?

The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.

Is this role remote?

It is a hybrid role: part remote, part in the office.

What tools and technologies does the posting mention?

AI/ML, LLMs, Generative AI, Multi-agent systems, LLM orchestration, Retrieval + reasoning, Personalization, Ranking systems, Recommendation systems, Model serving, Inference infrastructure, ML lifecycle governance, MLOps, Distributed ML systems, Agentic AI.