Senior Technical Product Manager – AI Agents
- Santa Clara, CA ; Remote - US
- Remote
- Senior level
- 8+ yrs experience
- Platform Product Management
- Visa: not specified
- $168k–$328k
The role in 30 seconds
NVIDIA is looking for a Senior Technical Product Manager to lead NeMo Relay, an open-source library that helps developers observe and control what happens inside agent runs. This role involves defining the strategy and roadmap for the library, driving adoption through integrations, and working with engineering and the open-source community to deliver value for agentic AI development.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- B2B infrastructure / API / developer tools
- Internal tooling / back-office systems
- Platform product management
- Developers / technical users
- Internal users (employees, ops teams)
Workable stretch
- B2B enterprise platform / workflow software
- Creator / builder / self-serve tool
- Enterprise users (complex workflows, admin panels, role-based access)
- SMB / small business (self-serve, simplicity-focused)
- Startup / greenfield (build from scratch, speed over polish)
Harder transition
- B2C consumer-facing application
- Marketplace / multi-sided platform
- Embedded systems / hardware-adjacent
- Data platform / ML pipeline
- Consumer / general public (high polish, conversion-focused)
Industry: Software, SaaS & AI Platform. See your personal match score
What they're really screening for
Must-haves
- CORE Deep familiarity with the AI agent landscape: open-source frameworks, coding agents and harnesses, and commercial agent platforms.
- CORE Proven understanding of agent execution, including LLM calls, tool calls, and multi-agent workflows.
- CORE Understanding of what developers need to operate agents in production: tracing, evaluation, guardrails, and cost and performance tuning.
- CORE Product management background on developer-facing libraries, SDKs, or infrastructure that other companies build on.
- CORE Proven track record to lead product direction in ambiguous, fast paced areas and to influence engineering, ecosystem, and leadership partners without direct authority.
- PLUS BS or MS in Computer Science, Electrical Engineering, or equivalent experience.
- CORE 8+ years of combined work in software development, ML ops, and/or technical product management, including 5+ years shipping enterprise software or infrastructure.
Nice-to-haves
- CORE History of taking an open-source project from early releases to broad ecosystem adoption.
- CORE Track record of ecosystem-led go-to-market, such as integrations, co-engineering, or embedding into third-party products.
- PLUS Hands-on familiarity with OpenTelemetry, OpenInference, or agent tracing and evaluation tools.
- PLUS Ability to make exceptional runtime concepts simple for both developers and executives.
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- AI Agents
- NeMo Relay
- NeMo Fabric
- NeMo Compass
- OpenShell
- NeMo Guardrails
- LLM
- SDKs
- ML Ops
- OpenTelemetry
- OpenInference
Concepts & phrases
- Senior Technical Product Manager
- AI Agents
- NeMo Relay
- open-source library
- agent runs
- agent frameworks
- developer tools
- observability platforms
- NVIDIA's stack
- vision, strategy, and multi-release roadmap
- framework-neutral library
- lifecycle events, middleware, plugins
- adaptive performance tuning
- Drive adoption through integrations
- coding-agent harnesses
Words that count as the same thing: "AI Agents" ≈ Agentic AI, Autonomous Agents, LLM Agents · "NeMo Relay" ≈ AI Agent Observability Library, Framework-Neutral Agent Control Library · "open-source frameworks" ≈ OSS frameworks, Publicly available AI agent frameworks · "coding agents and harnesses" ≈ Agent execution frameworks, LLM agent orchestration tools · "agent observability" ≈ AI agent monitoring, Agent performance tracking
Check my résumé against these keywordsHiring at NVIDIA
All NVIDIA hiring dataOpen senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at NVIDIA
- Senior Product Manager - NVIDIA Sentry and DOCA Security $208k–$380k
- Senior System Software Engineer, NPI Data Center $152k–$242k
- Senior Software Engineer - Quantum Simulations $184k–$357k
- Senior Manager, Technical Program Management — Planning $200k–$322k
- Senior Staff Software Engineer $200k–$322k
Full job description from NVIDIA
From NVIDIA's posting. View the original
NVIDIA is the defining technology company of the AI era. We are looking for a Senior Technical Product Manager to lead NeMo Relay, an open-source library that helps developers observe and control what happens inside agent runs, without replacing the frameworks, models, or tools they already use.
Our team builds open-source libraries and reference architectures for agentic AI, including NeMo Relay, NeMo Fabric, and NemoClaw. We go to market through the ecosystem: our software is composed to be embedded into agent frameworks, developer tools, observability platforms, and third-party solutions, helping customers build agents that are safer, more observable, and more efficient on NVIDIA’s stack.
Show full description Show less
What you'll be doing:
• Take charge of the vision, strategy, and multi-release roadmap for NeMo Relay as a framework-neutral library partners can embed, addressing lifecycle events, middleware, plugins, policy, observability, and adaptive performance tuning.
• Drive adoption through integrations with agent frameworks, coding-agent harnesses, observability vendors, and ISVs, and build the examples that show developers how to use Relay in real systems.
• Partner with the teams behind NeMo Guardrails, NeMo Fabric, NeMo Compass and OpenShell to make Relay work seamlessly with their components.
• Turn open-source community and ecosystem feedback into prioritized product decisions.
• Work with engineering and program management to plan releases and keep roadmap communications accurate.
• Become a recognized voice in agent observability, safety, and optimization through talks, content, and community engagement.
What we need to see:
• Deep familiarity with the AI agent landscape: open-source frameworks, coding agents and harnesses, and commercial agent platforms.
• Proven understanding of agent execution, including LLM calls, tool calls, and multi-agent workflows.
• Understanding of what developers need to operate agents in production: tracing, evaluation, guardrails, and cost and performance tuning.
• Product management background on developer-facing libraries, SDKs, or infrastructure that other companies build on.
• Proven track record to lead product direction in ambiguous, fast paced areas and to influence engineering, ecosystem, and leadership partners without direct authority.
• BS or MS in Computer Science, Electrical Engineering, or equivalent experience.
• 8+ years of combined work in software development, ML ops, and/or technical product management, including 5+ years shipping enterprise software or infrastructure.
Ways to stand out from the crowd:
• History of taking an open-source project from early releases to broad ecosystem adoption.
• Track record of ecosystem-led go-to-market, such as integrations, co-engineering, or embedding into third-party products.
• Hands-on familiarity with OpenTelemetry, OpenInference, or agent tracing and evaluation tools.
• Ability to make exceptional runtime concepts simple for both developers and executives.
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
168,000 USD – 258,750 USD for Level 4; and 208,000 USD – 327,750 USD for Level 5.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 13, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
FAQ
How much does a Senior Technical Product Manager – AI Agents at NVIDIA make?
The posted pay for this role is $168k–$328k a year.
How much experience do you need?
The posting asks for 8+ years in software development, ml ops, and/or technical product management. It is a senior-level role.
Does NVIDIA sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is a remote role.
What tools and technologies does the posting mention?
AI Agents, NeMo Relay, NeMo Fabric, NeMo Compass, OpenShell, NeMo Guardrails, LLM, SDKs, ML Ops, OpenTelemetry, OpenInference.