Principal Software Engineer, Cloud Infrastructure

NVIDIA

  • Santa Clara, CA
  • On-site
  • Staff/Principal level
  • 15+ yrs experience
  • Platform, Infrastructure & SRE
  • Visa: not specified
  • $272k–$431k

The role in 30 seconds

The Principal Software Engineer will architect and lead the development of large-scale OpenStack cloud infrastructure, supporting bare-metal provisioning and virtual machines across multiple datacenters. This role focuses on automating infrastructure operations, improving platform scalability and reliability, and ensuring safe deployment mechanisms for NVIDIA's internal engineering workloads.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • B2B infrastructure / API / developer tools
  • Internal tooling / back-office systems
  • Enterprise-scale
  • Growth-stage

Workable stretch

  • B2B enterprise platform / workflow software
  • Data platform / ML pipeline
  • Startup / greenfield

Harder transition

  • B2C consumer-facing application
  • Creator / builder / self-serve tool
  • Marketplace / multi-sided platform
  • Embedded systems / hardware-adjacent
  • Regulated environment (healthcare, finance, government)

Industry: Software, SaaS & AI Platform. See your personal match score

What they're really screening for

Must-haves

  • CORE 15+ years of proven experience in software engineering, distributed systems, or cloud infrastructure, demonstrating leadership in diverse technical initiatives across teams. BS or MS in Computer Science, Computer Engineering, or a related field, or equivalent experience.
  • CORE Deep experience crafting, developing, deploying, and fixing production OpenStack environments, particularly Nova, Neutron, and Ironic.
  • CORE Strong software development skills in Python and experience building maintainable services, APIs, and infrastructure automation.
  • CORE Strong understanding of distributed systems, including concurrency, state management, asynchronous workflows, failure handling, and recovery.
  • CORE Deep Linux systems knowledge and experience with virtualization, KVM/QEMU, containers, and guest-operating system provisioning.
  • CORE Proven understanding of cloud networking, including L2/L3 networking, VLANs, overlays, DHCP, PXE boot, routing, and tenant isolation.
  • PLUS Experience with databases and messaging infrastructure supporting cloud control planes, such as MySQL/MariaDB and RabbitMQ.
  • CORE Experience operating infrastructure with demanding reliability requirements, including monitoring, incident response, system resources, and production upgrades.
  • CORE Excellent debugging skills across hardware, firmware, operating systems, communication systems, data storage, and distributed services.
  • CORE Ability to translate ambiguous requirements into technical direction and influence engineering teams across organizational boundaries and time zones.

Nice-to-haves

  • PLUS Contributions to OpenStack or related open-source projects, including upstream features, bug fixes, performance improvements, or architectural proposals.

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • Principal Software Engineer
  • Cloud Infrastructure
  • OpenStack
  • bare-metal provisioning
  • virtual machines
  • Infrastructure as Code
  • Python
  • APIs
  • Linux
  • KVM/QEMU
  • containers
  • cloud networking
  • VLANs
  • overlays
  • DHCP

Concepts & phrases

  • Principal Software Engineer
  • Cloud Infrastructure
  • bare-metal and cloud compute infrastructure
  • datacenter capacity
  • compute services
  • NVIDIA GPU Private cloud
  • continuous integration and validation
  • system software
  • rack-scale systems
  • individual contributor role
  • architectural leadership
  • OpenStack platform
  • infrastructure operations
  • complex systems challenges
  • large-scale OpenStack infrastructure

Words that count as the same thing: "OpenStack" ≈ Open Cloud Computing Platform · "Infrastructure as Code" ≈ IaC, Terraform, Ansible · "Control planes" ≈ Orchestration layers · "Bare-metal provisioning" ≈ Hardware deployment · "Virtual machines" ≈ VMs

Check my résumé against these keywords

Hiring at NVIDIA

All NVIDIA hiring data

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at NVIDIA

Full job description from NVIDIA

From NVIDIA's posting. View the original

We are seeking a Principal Software Engineer to drive the architecture and development of our bare-metal and cloud compute infrastructure. Our organization supports hundreds of megawatts of datacenter capacity, making a growing physical fleet available as reliable, secure, and efficient compute services for NVIDIA engineering.

We operate an NVIDIA GPU Private cloud that provides infrastructure for continuous integration and validation. Hardware, firmware, drivers, networking, and system software are coordinated and tested on their path to production. The fleet includes x86 and Arm servers, GPUs, DPUs, high-speed networking, storage, and rack-scale systems. Platforms include Grace Blackwell and Vera Rubin. In this senior individual contributor role, you will combine hands-on software engineering with architectural leadership. You will evolve our OpenStack platform, automate infrastructure operations, and address complex systems challenges across multiple datacenters.

Show full description Show less

What you'll be doing:

• Own architecture and lead implementation of large-scale OpenStack infrastructure supporting bare-metal provisioning, virtual machines, and engineering workloads spanning several datacenters around the globe.
• Architect and implement Infrastructure as Code frameworks to automate provisioning, configuration, and lifecycle management across OpenStack and bare-metal environments, using version-controlled definitions, automated validation, drift detection, and safe rollback.
• Build and improve compute control planes, resource scheduling, topology-aware placement, reservations, and capacity management for heterogeneous hardware.
• Develop and extend OpenStack services and integrations, including Nova, Neutron, Ironic, Cinder, Keystone, and Placement, based on platform requirements.
• Improve platform scalability, availability, and performance through architectural changes, profiling, failure analysis, and detailed elimination of operational bottlenecks.
• Build safe deployment, upgrade, migration, and rollback mechanisms that minimize disruption to engineering workloads.
• Partner with SRE, datacenter operations, security, product engineering teams to onboard new platforms and resolve failures across system boundaries.

What we need to see:

• 15+ years of proven experience in software engineering, distributed systems, or cloud infrastructure, demonstrating leadership in diverse technical initiatives across teams. BS or MS in Computer Science, Computer Engineering, or a related field, or equivalent experience.
• Deep experience crafting, developing, deploying, and fixing production OpenStack environments, particularly Nova, Neutron, and Ironic.
• Strong software development skills in Python and experience building maintainable services, APIs, and infrastructure automation.
• Strong understanding of distributed systems, including concurrency, state management, asynchronous workflows, failure handling, and recovery.
• Deep Linux systems knowledge and experience with virtualization, KVM/QEMU, containers, and guest operating-system provisioning.
• Proven understanding of cloud networking, including L2/L3 networking, VLANs, overlays, DHCP, PXE boot, routing, and tenant isolation.
• Experience with databases and messaging infrastructure supporting cloud control planes, such as MySQL/MariaDB and RabbitMQ.
• Experience operating infrastructure with demanding reliability requirements, including monitoring, incident response, system resources, and production upgrades.
• Excellent debugging skills across hardware, firmware, operating systems, communication systems, data storage, and distributed services.
• Ability to translate ambiguous requirements into technical direction and influence engineering teams across organizational boundaries and time zones.

Ways to stand out from the crowd:

• Contributions to OpenStack or related open-source projects, including upstream features, bug fixes, performance improvements, or architectural proposals.
• Experience scaling OpenStack across multiple regions or datacenters, including control-plane resilience, fleet upgrades, and workload migration.
• Expertise in Ironic, Redfish, BMC integration, and provisioning or recovering large bare-metal fleets. Experience with Ceph, distributed storage, and storage integration with OpenStack.
• Experience with GPU and Arm platforms, PCIe pass-through, SR-IOV, NVLink, InfiniBand, or high-speed Ethernet.
• A record of delivering architectural improvements that measurably increase reliability, scalability, utilization, or developer efficiency.

NVIDIA brings together engineers working on some of the most ambitious problems in computing. Join us to build the infrastructure that enables the next generation of NVIDIA hardware and software. Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 272,000 USD – 431,250 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 13, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

FAQ

How much does a Principal Software Engineer, Cloud Infrastructure at NVIDIA make?

The posted pay for this role is $272k–$431k a year.

How much experience do you need?

The posting asks for 15+ years in software engineering or cloud infrastructure. It is a staff/principal-level role.

Does NVIDIA sponsor visas for this role?

The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.

Is this role remote?

It is an on-site role.

What tools and technologies does the posting mention?

Principal Software Engineer, Cloud Infrastructure, OpenStack, bare-metal provisioning, virtual machines, Infrastructure as Code, Python, APIs, Linux, KVM/QEMU, containers, cloud networking, VLANs, overlays, DHCP.