Senior Software Workload Optimization Engineer

NVIDIA

  • Seattle, WA ; Remote - US
  • Remote
  • Senior level
  • 5+ yrs experience
  • Platform, Infrastructure & SRE
  • Visa: not specified
  • $150k–$286k

The role in 30 seconds

The numerics team at NVIDIA works on techniques to make LLMs more efficient, seeking a software optimization engineer to improve GPU utilization for AI workloads. You will independently lead investigations into performance bottlenecks and implement optimizations to reduce GPU hours per unit of useful work.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • B2B infrastructure / API / developer tools
  • Software, SaaS & AI Platform companies
  • Enterprise-scale (high availability, compliance, large distributed systems)
  • Growth-stage (scaling existing systems, reliability concerns)

Workable stretch

  • B2B enterprise platform / workflow software
  • Internal tooling / back-office systems
  • Startup / greenfield (build from scratch, speed over polish)

Harder transition

  • B2C consumer-facing application
  • Embedded systems / hardware-adjacent

Industry: Software, SaaS & AI Platform. See your personal match score

What they're really screening for

Must-haves

  • CORE Experience analyzing and improving the performance of compute-intensive software
  • PLUS Bachelor’s degree or equivalent experience, and 5+ years of relevant experience
  • CORE Ability to reason about and optimize parallelism strategies – including tensor, data, pipeline, context, and expert parallelism – to balance throughput, communication overhead, and GPU resource use.
  • CORE Investigate unfamiliar code/systems and work directly with code owners to land end-to-end optimizations.
  • CORE Understanding of GPU architecture and the factors that affect utilization and application performance.
  • CORE Experience using profiling, benchmarking, and measurement to guide optimization decisions.
  • CORE Ability to work independently, communicate findings clearly, and collaborate with researchers and engineers.
  • PLUS Three or more years of relevant experience.

Nice-to-haves

  • CORE Optimizing AI training, inference, evaluation, or other large-scale GPU workloads.
  • CORE Working with GPU programming or machine learning frameworks and performance tools.
  • PLUS Improving workload scheduling, batching, data pipelines, or multi-GPU configurations.
  • PLUS Familiarity with collection and interpretation of GPU telemetry
  • PLUS Energy-proportional computing or performance optimization under power, energy, or thermal design power budgets and experience with model quantization or numerical methods.

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • GPU
  • LLMs
  • AI
  • software optimization
  • tensor cores
  • CUDA
  • Profiling
  • Benchmarking
  • Measurement
  • Parallelism
  • Tensor parallelism
  • Data parallelism
  • Pipeline parallelism
  • Context parallelism
  • Expert parallelism

Concepts & phrases

  • Senior Software Workload Optimization Engineer
  • numerics team at NVIDIA
  • reduce the GPU hours
  • AI workloads
  • software optimization engineer
  • performance of evaluation
  • Identify bottlenecks
  • computation, memory, communication
  • data movement, orchestration
  • resource allocation
  • parallelism configurations
  • distributed across GPUs
  • effective use of GPU capabilities
  • tensor cores
  • improve utilization

Words that count as the same thing: "AI workloads" ≈ Artificial Intelligence workloads, Machine Learning workloads · "GPU hours" ≈ GPU time, Compute hours on GPUs · "useful work" ≈ meaningful computation, task completion · "parallelism strategies" ≈ parallel processing techniques, concurrent execution strategies · "throughput" ≈ processing rate, data processing volume

Check my résumé against these keywords

Hiring at NVIDIA

All NVIDIA hiring data

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at NVIDIA

Full job description from NVIDIA

From NVIDIA's posting. View the original

Our numerics team at NVIDIA works on techniques that make LLMs more efficient. We’re looking for a software optimization engineer to help us get more useful work done from our GPUs. You’ll join a small team and independently lead investigations into a range of AI workloads. One current opportunity is reducing the GPU hours needed to evaluate models, but the work will evolve as priorities and bottlenecks change. You’ll approach workloads as systems: measure how they perform, identify what limits useful throughput, implement improvements, and verify the results. You don’t need to be an expert in quantization algorithms. We’re looking for someone who enjoys understanding how software uses GPUs and finding practical ways to make it run more efficiently.

Show full description Show less

What you’ll be doing:

• Investigate the performance of evaluation and other AI workloads across GPU systems.
• Identify bottlenecks in computation, memory, communication, data movement, orchestration, and resource allocation.
• Evaluate and improve parallelism configurations, including how work is distributed across GPUs and nodes.
• Understand how effectively workloads use GPU capabilities, including tensor cores, and identify opportunities to improve utilization.
• Implement and validate changes that reduce GPU hours per unit of useful work or increase throughput.
• Design clear benchmarks and measurements, accounting for tradeoffs among throughput, latency, resource use, and the quality or correctness of results.
• Partner with workload owners to understand requirements, test improvements, and help deploy solutions.
• Independently prioritize and drive optimization projects from investigation through measurable results.

What we need to see:

• Experience analyzing and improving the performance of compute-intensive software
• Bachelor’s degree or equivalent experience, and 5+ years of relevant experience
• Ability to reason about and optimize parallelism strategies – including tensor, data, pipeline, context, and expert parallelism – to balance throughput, communication overhead, and GPU resource use.
• Investigate unfamiliar code/systems and work directly with code owners to land end-to-end optimizations.
• Understanding of GPU architecture and the factors that affect utilization and application performance.
• Experience using profiling, benchmarking, and measurement to guide optimization decisions.
• Ability to work independently, communicate findings clearly, and collaborate with researchers and engineers.
• Three or more years of relevant experience.

Ways to stand out from the crowd.

• Optimizing AI training, inference, evaluation, or other large-scale GPU workloads.
• Working with GPU programming or machine learning frameworks and performance tools.
• Improving workload scheduling, batching, data pipelines, or multi-GPU configurations.
• Familiarity with collection and interpretation of GPU telemetry
• Energy-proportional computing or performance optimization under power, energy, or thermal design power budgets and experience with model quantization or numerical methods.

Success in this role means measurably reducing the GPU resources required to deliver useful results across our workloads.

#LI-Hybrid

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
150,000 USD – 286,000 USD for Level 3; and 183,750 USD – 351,000 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 20, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

FAQ

How much does a Senior Software Workload Optimization Engineer at NVIDIA make?

The posted pay for this role is $150k–$286k a year.

How much experience do you need?

The posting asks for 5+ years in software workload optimization. It is a senior-level role.

Does NVIDIA sponsor visas for this role?

The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.

Is this role remote?

It is a remote role.

What tools and technologies does the posting mention?

GPU, LLMs, AI, software optimization, tensor cores, CUDA, Profiling, Benchmarking, Measurement, Parallelism, Tensor parallelism, Data parallelism, Pipeline parallelism, Context parallelism, Expert parallelism.