Senior Software Engineer, Distributed Systems - NIM Factory
- Santa Clara, CA ; Texas ; New York ; California
- Remote
- Senior level
- 8+ yrs experience
- Backend Engineering
- Visa: not specified
- $184k–$288k
The role in 30 seconds
NVIDIA is seeking a senior engineer to design and build factory infrastructure and automation for NVIDIA Inference Microservices (NIMs). You will apply your deep technical expertise to design an efficient, scalable and reliable automation factory infrastructure that will take AI models to become NIMs that are validated for best in class performance and accuracy. NVIDIA is building a new category of products, by intersecting our prowess in deep learning and computing, with industry-leading technologies. You will harness groundbreaking technologies, and build a highly efficient factory to power how NVIDIA builds and validates NIMs for inferencing all the way through deployment in heterogeneous hardware and software environments.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- Internal tooling / back-office systems
- B2B enterprise platform / workflow software
- B2B infrastructure / API / developer tools
- Data platform / ML pipeline
- Growth-stage
Workable stretch
- B2C consumer-facing application
- Creator / builder / self-serve tool
- Marketplace / multi-sided platform
- Startup / greenfield
Harder transition
- Embedded systems / hardware-adjacent
- Regulated environment (healthcare, finance, government)
Industry: Software, SaaS & AI Platform. See your personal match score
What they're really screening for
Must-haves
- CORE Advanced programming skills to build distributed and compute systems, backend services, microservices and cloud technologies.
- PLUS Effective experience working with multi-functional teams, principals and architects, across organizational boundaries.
- PLUS Mentorship, growing teams and team members, and the flexibility to ability to adjust your direction and expectations given the needs of our customers.
- CORE Deep technical expertise in distributed containerize applications using technologies such as Docker, K8s, Cloud Endpoints, Helm, and Prometheus.
- PLUS Passion for building rich, microservice applications build and test automation pipeline.
- PLUS Excellent interpersonal skills and the ability to lead multi-functional efforts
- CORE Proven experience debugging and analyzing the performance of distributed microservices or cloud systems.
- PLUS BS or MS in Computer Science, Computer Engineering or related field (or equivalent experience)
- CORE 8+ years of shown experience developing performant microservice, cloud software and/or tooling roles
- CORE Experience building factory infrastructure and automation for NVIDIA Inference Microservices (NIMs).
Nice-to-haves
- PLUS Experience delivering event-driven applications using various services such as Temporal, Kafka, Redis or others and a demonstrable ability to discuss the pros and cons of these choices.
- CORE A history of building and deploying containers for Microservices, Cloud and On-prem deployments, and their associated CI/CD pipelines
- PLUS Prior experience in working with large scale full stack development
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- NVIDIA
- AI
- NIMs
- NVIDIA Inference Microservices
- GPUs
- Docker
- K8s
- Cloud Endpoints
- Helm
- Prometheus
- Temporal
- Kafka
- Redis
- Microservices
- Kubernetes
Concepts & phrases
- Senior Software Engineer
- Distributed Systems
- NIM Factory
- NVIDIA Inference Microservices
- AI model
- deployable service
- Cloud, On-prem and Kubernetes
- technical strategies and roadmaps
- factory pipeline
- compute infrastructure
- scalable and reliable
- AI model teams
- user feedback
- distributed containerize applications
- Docker, K8s, Cloud Endpoints, Helm, and Prometheus
Words that count as the same thing: "NIMs" ≈ NVIDIA Inference Microservices · "K8s" ≈ Kubernetes
Check my résumé against these keywordsHiring at NVIDIA
All NVIDIA hiring dataOpen senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at NVIDIA
- Senior Product Manager - NVIDIA Sentry and DOCA Security $208k–$380k
- Senior System Software Engineer, NPI Data Center $152k–$242k
- Senior Software Engineer - Quantum Simulations $184k–$357k
- Senior Manager, Technical Program Management — Planning $200k–$322k
- Senior Staff Software Engineer $200k–$322k
Full job description from NVIDIA
From NVIDIA's posting. View the original
NVIDIA is the platform upon which every new AI-powered application is built. We are seeking a senior engineer to design and build factory infrastructure and automation for NVIDIA Inference Microservices (NIMs). The right person for this role brings technical drive and creativity to change the way NVIDIA optimizes and serves performant inferencing for every AI model in a heterogeneous cluster environments. Our NIM offerings are easy to use, highly performant and tested in all deployment scenarios, in the cloud, on customer’s self-hosted infrastructure and locally on all NVIDIA GPUs. You will apply your deep technical expertise to design an efficient, scalable and reliable automation factory infrastructure that will take AI models to become NIMs that are validated for best in class performance and accuracy.
Show full description Show less
NVIDIA is building a new category of products, by intersecting our prowess in deep learning and computing, with industry-leading technologies. You will harness groundbreaking technologies, and build a highly efficient factory to power how NVIDIA builds and validates NIMs for inferencing all the way through deployment in heterogeneous hardware and software environments. You will influence and drive technical advances in NVIDIAs workflows and build the infrastructure that strives to accelerate the delivery of every AI model on NVIDIA's GPUs anywhere. We are looking for technical talent to design and build our factory capabilities, including the underlying infrastructure, pipelines, backends, Docker build, test harness, metrics, performance engineering, log ingestion, and more.
What you'll be doing:
• Develop a factory pipeline that will take an AI model in and produce a deployable service that is validated across Cloud, On-prem and Kubernetes environments. With the team, define and deliver rapid iterations on the group's technical strategies and roadmaps to deliver and improve the NIM factory. You will be designing interfaces, data modeling and schema design, and expanding observability over the factory pipeline and its compute infrastructure.
• Work with technical leaders designing and developing scalable and reliable factory components. You will collaborate with multiple AI model teams to understand their requirements to build an efficient infrastructure that improves every teams' productivity.
• Define metrics and drive improvements based on user feedback. You will mentor and collaborate throughout the team and with other teams to grow your colleagues and yourself. You will have a history of learning and growing your skills and those around you.
What we need to see:
• A history of using your advanced programming skills to build distributed and compute systems, backend services, microservices and cloud technologies.
• Effective experience working with multi-functional teams, principals and architects, across organizational boundaries.
• Mentorship, growing teams and team members, and the flexibility to ability to adjust your direction and expectations given the needs of our customers.
• Deep technical expertise in distributed containerize applications using technologies such as Docker, K8s, Cloud Endpoints, Helm, and Prometheus.
• Passion for building rich, microservice applications build and test automation pipeline.
• Excellent interpersonal skills and the ability to lead multi-functional efforts
• Proven experience debugging and analyzing the performance of distributed microservices or cloud systems.
• BS or MS in Computer Science, Computer Engineering or related field (or equivalent experience)
• 8+ years of shown experience developing performant microservice, cloud software and/or tooling roles
Ways to stand out from the crowd:
• Experience delivering event-driven applications using various services such as Temporal, Kafka, Redis or others and a demonstrable ability to discuss the pros and cons of these choices.
• A history of building and deploying containers for Microservices, Cloud and On-prem deployments, and their associated CI/CD pipelines
• Prior experience in working with large scale full stack development
We are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and creative people in the world working for us. If you're creative and autonomous with a real passion for technology we want to hear from you.
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 184,000 USD – 287,500 USD.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 6, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
FAQ
How much does a Senior Software Engineer, Distributed Systems - NIM Factory at NVIDIA make?
The posted pay for this role is $184k–$288k a year.
How much experience do you need?
The posting asks for 8+ years in microservice, cloud software and/or tooling. It is a senior-level role.
Does NVIDIA sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is a remote role.
What tools and technologies does the posting mention?
NVIDIA, AI, NIMs, NVIDIA Inference Microservices, GPUs, Docker, K8s, Cloud Endpoints, Helm, Prometheus, Temporal, Kafka, Redis, Microservices, Kubernetes.