Senior Software Engineer, Agentic Systems
- Santa Clara, CA ; New York ; Colorado ; Washington ; Massachusetts
- Remote
- Senior level
- 5+ yrs experience
- Backend Engineering
- Visa: not specified
- $184k–$357k
The role in 30 seconds
We are looking for a Senior Software Engineer to help build NVIDIA's product for developing, evaluating, deploying, and operating AI systems at scale. This role will focus on understanding whether changes to AI agents are making those agents better, providing infrastructure for observing behavior, measuring progress, catching regressions, and iterating with confidence. Our roadmap is increasingly focused on agentic development and automated agent improvement.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- Software, SaaS & AI Platform
- B2B infrastructure / API / developer tools
- AI platform
- Growth-stage
- Enterprise-scale
Workable stretch
- Internal tooling / back-office systems
- B2B enterprise platform / workflow software
- Creator / builder / self-serve tool
- Startup / greenfield
Harder transition
- B2C consumer-facing application
- Marketplace / multi-sided platform
- Embedded systems / hardware-adjacent
- Data platform / ML pipeline
- Regulated environment
Industry: Software, SaaS & AI Platform. See your personal match score
What they're really screening for
Must-haves
- PLUS BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field
- CORE 5+ years of professional software engineering experience building production systems
- CORE Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis, and maintainable software design
- CORE Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces
- CORE Experience with distributed systems, cloud-native services, containers, Kubernetes, or job orchestration
- CORE Strong understanding of reliability, scalability, security, and performance tradeoffs in production infrastructure
- CORE Experience with structured data modeling and validation systems such as Pydantic, typed schemas, event/trace models, or SDK-generated types
- CORE Ability to work independently, define technical scope, break down ambiguous problems, and drive work across team boundaries
- CORE Clear communication skills and a track record of collaborating with engineering, product, research, or customer-facing teams
Nice-to-haves
- CORE Experience building, deploying, and iterating on production agentic AI systems where evaluation was used to measure and improve real product outcomes
- CORE Experience designing evaluation workflows for heterogeneous agents, including tool-using agents, RAG agents, workflow agents, coding agents, or long-running autonomous systems
- CORE Experience integrating evaluation capabilities across multiple products, runtimes, or internal platforms, especially through Python SDKs, plugins, or shared developer tooling
- CORE Strong ability to connect technical evaluation work to business outcomes, product quality, user experience, reliability, or operational efficiency
- CORE Experience with enterprise AI systems where measurement, regression testing, observability, governance, and continuous improvement are required for production deployment
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- Senior Software Engineer
- Agentic Systems
- NeMo Platform
- AI
- Python
- APIs
- SDK
- plugin interfaces
- runtimes
- product surfaces
- distributed systems
- cloud-native services
- containers
- Kubernetes
- job orchestration
Concepts & phrases
- Senior Software Engineer
- Agentic Systems
- NeMo Platform
- AI systems at scale
- agentic development
- automated agent improvement
- Python-first APIs
- SDK workflows
- plugin interfaces
- reusable systems
- agent execution data
- evaluation datasets
- NVIDIA agent runtimes
- developer workflows
- emerging agent development
Words that count as the same thing: "Agentic Systems" ≈ AI agents, autonomous AI systems · "NeMo Platform" ≈ NVIDIA AI platform · "RAG" ≈ Retrieval-Augmented Generation
Check my résumé against these keywordsHiring at NVIDIA
All NVIDIA hiring dataOpen senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at NVIDIA
- Senior Product Manager - NVIDIA Sentry and DOCA Security $208k–$380k
- Senior System Software Engineer, NPI Data Center $152k–$242k
- Senior Software Engineer - Quantum Simulations $184k–$357k
- Senior Manager, Technical Program Management — Planning $200k–$322k
- Senior Staff Software Engineer $200k–$322k
Full job description from NVIDIA
From NVIDIA's posting. View the original
We are looking for a Senior Software Engineer to help build NeMo Platform, NVIDIA’s product for developing, evaluating, deploying, and operating AI systems at scale. This role will focus on NeMo Evaluator, which helps teams understand whether changes to AI agents are making those agents better. As AI systems become more autonomous and more deeply integrated into real workflows, teams need practical infrastructure for observing behavior, measuring progress, catching regressions, and iterating with confidence.
Show full description Show less
Our roadmap is increasingly focused on agentic development and automated agent improvement: giving teams the infrastructure they need to compare versions, understand behavior, and make empirically grounded improvements over time.
What you'll be doing:
• Design and implement Python-first APIs, SDK workflows, and plugin interfaces for building, measuring, and improving agents across multiple runtimes and product surfaces
• Build reusable systems for observing behavior, measuring progress, detecting regressions, and turning runtime evidence into product decisions
• Build systems for ingesting, normalizing, validating, and analyzing agent execution data and evaluation datasets
• Partner with research, product, platform, and infrastructure teams to integrate agentic capabilities broadly across NVIDIA agent runtimes and developer workflows
• Help turn emerging agent development and improvement techniques into reliable, reusable product capabilities
• Improve reliability, observability, debuggability, and performance across NeMo Platform, SDKs, plugins, jobs, and developer workflows
• Build strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows
• Drive “speed of light” engineering: fast iteration, high ownership, pragmatic decisions, and performance-minded implementation under production constraints
• Provide senior technical leadership through design reviews, code reviews, mentoring, and ownership of ambiguous cross-component problems
What we need to see:
• BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field
• 5+ years of professional software engineering experience building production systems
• Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis, and maintainable software design
• Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces
• Experience with distributed systems, cloud-native services, containers, Kubernetes, or job orchestration
• Strong understanding of reliability, scalability, security, and performance tradeoffs in production infrastructure
• Experience with structured data modeling and validation systems such as Pydantic, typed schemas, event/trace models, or SDK-generated types
• Ability to work independently, define technical scope, break down ambiguous problems, and drive work across team boundaries
• Clear communication skills and a track record of collaborating with engineering, product, research, or customer-facing teams
Ways to stand out from the crowd:
• Experience building, deploying, and iterating on production agentic AI systems where evaluation was used to measure and improve real product outcomes
• Experience designing evaluation workflows for heterogeneous agents, including tool-using agents, RAG agents, workflow agents, coding agents, or long-running autonomous systems
• Experience integrating evaluation capabilities across multiple products, runtimes, or internal platforms, especially through Python SDKs, plugins, or shared developer tooling
• Strong ability to connect technical evaluation work to business outcomes, product quality, user experience, reliability, or operational efficiency
• Experience with enterprise AI systems where measurement, regression testing, observability, governance, and continuous improvement are required for production deployment
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you’re passionate about leading breakthrough AI research and building exceptional teams that shape the future of computing, we want to hear from you.
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
184,000 USD – 287,500 USD for Level 4; and 224,000 USD – 356,500 USD for Level 5.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 10, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
FAQ
How much does a Senior Software Engineer, Agentic Systems at NVIDIA make?
The posted pay for this role is $184k–$357k a year.
How much experience do you need?
The posting asks for 5+ years in software engineering. It is a senior-level role.
Does NVIDIA sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is a remote role.
What tools and technologies does the posting mention?
Senior Software Engineer, Agentic Systems, NeMo Platform, AI, Python, APIs, SDK, plugin interfaces, runtimes, product surfaces, distributed systems, cloud-native services, containers, Kubernetes, job orchestration.