Senior Platform Engineer, AI Infrastructure

Focused

  • Chicago, IL ; Denver, CO
  • Senior level
  • 10+ yrs experience
  • Platform Engineering
  • No visa sponsorship
  • $185k–$225k

The role in 30 seconds

Focused is looking for a Senior Platform Engineer to lead the build-out of an enterprise AI platform for a global enterprise client. You will design the foundation their teams use to ship LLM applications and agents, including Kubernetes, GPU capacity, security, and guardrails that allow hundreds of engineers to move fast without breaking things. You will set technical direction and mentor a Platform Engineer working alongside you.

Is this role a fit for you?

The backgrounds this role is most likely to hire from, as RoleStack reads the posting.

Strong match

  • B2B infrastructure / API / developer tools
  • B2B enterprise platform / workflow software
  • Software, SaaS & AI Platform
  • Internal tooling / back-office systems
  • Enterprise-scale (high availability, compliance, large distributed systems)

Workable stretch

  • Creator / builder / self-serve tool
  • Marketplace / multi-sided platform
  • Data platform / ML pipeline
  • Startup / greenfield (build from scratch, speed over polish)

Harder transition

  • B2C consumer-facing application
  • Embedded systems / hardware-adjacent
  • Regulated environment (healthcare, finance, government)

Industry: Software, SaaS & AI Platform. See your personal match score

What they're really screening for

Must-haves

  • CORE 10+ years in infrastructure, platform, or DevOps engineering
  • CORE Deep production experience with Kubernetes, including Azure AKS
  • PLUS Hands-on experience with GCP
  • CORE Expert-level Terraform
  • CORE Experience running GPU infrastructure (NVIDIA GPU Operator, node pools, scheduling, or similar)
  • CORE Experience building infrastructure that supports LLM workloads in production
  • CORE Strong cloud security background: IAM, networking, secrets, policy as code
  • CORE Experience leading technical direction for a team
  • CORE Design and build a multi-tenant platform for LLM and agentic AI workloads, from model access to deployment
  • CORE Architect GPU infrastructure for inference and fine-tuning, including scheduling, autoscaling, and cost controls

Nice-to-haves

  • CORE Experience building an internal agentic AI platform
  • PLUS Familiarity with model serving (vLLM, Triton, KServe, Ray Serve)
  • PLUS Experience with Azure OpenAI or Vertex AI
  • PLUS Consulting or client-facing experience

Résumé keywords for this role

Terms the posting stresses. Include the ones you can honestly back up.

Tools & technologies

  • Kubernetes
  • Azure AKS
  • GCP GKE
  • Terraform
  • GPU Operator
  • NVIDIA GPU Operator
  • LLM
  • IAM
  • vLLM
  • Triton
  • KServe
  • Ray Serve
  • Azure OpenAI
  • Vertex AI
  • GitOps

Concepts & phrases

  • Senior Platform Engineer
  • AI Infrastructure
  • enterprise AI platform
  • LLM applications
  • agentic AI
  • Kubernetes
  • GPU capacity
  • AI Platform Architecture
  • multi-tenant platform
  • LLM and agentic AI workloads
  • model access
  • deployment
  • GPU infrastructure
  • inference and fine-tuning
  • scheduling, autoscaling, and cost controls

Words that count as the same thing: "agentic AI" ≈ AI agents, autonomous AI systems · "LLM" ≈ Large Language Model · "IaC" ≈ Infrastructure as Code · "GitOps" ≈ GitOps workflows · "CI/CD" ≈ Continuous Integration / Continuous Deployment

Check my résumé against these keywords

Hiring at Focused

Open senior roles RoleStack tracks right now, posted in the last 30 days.

More open roles at Focused

Full job description from Focused

From Focused's posting. View the original

Who we are:

At Focused, we move quickly to deliver quality software that achieves client outcomes and meets their customer's needs. We strategically partner with our clients to leverage our expertise in design and software, while our clients bring their own domain expertise. We work with a variety of clients from different industries, collaborating as we get new products to market, modernizing legacy systems, or helping teams learn the skills they need to be successful.

Show full description Show less

Our values:

• Listen first • We are experts in product practices but lifelong learners in the domain of our customers. We research, collaborate, and understand.

• Learn why • We ask questions and talk to users to understand problem spaces, objectives, and goals, which allows us to deeply invest and drive towards the outcomes of our clients.

• Love your craft • We love diving into a variety of domains and solving problems. We take pride in delivering value, in communicating progress, and guiding our clients to success.

We're looking for a Senior Platform Engineer to lead the build-out of an enterprise AI platform for a global enterprise client. You'll design the foundation their teams use to ship LLM applications and agents: Kubernetes, GPU capacity, security, and the guardrails that let hundreds of engineers move fast without breaking things. You'll set technical direction and mentor a Platform Engineer working alongside you.

Key Responsibilities:

AI Platform Architecture

• Design and build a multi-tenant platform for LLM and agentic AI workloads, from model access to deployment

• Architect GPU infrastructure for inference and fine-tuning, including scheduling, autoscaling, and cost controls

• Stand up shared services for agents: model gateways, secrets, tracing, evaluation, and deployment pipelines

• Make build-vs-buy calls and explain the tradeoffs to technical and executive stakeholders

Kubernetes & Cloud Infrastructure

• Architect and run production Kubernetes on Azure AKS and GCP GKE

• Own Terraform modules and IaC standards across environments

• Build CI/CD and GitOps workflows that make platform changes safe and repeatable

Security & Governance

• Design identity, network isolation, and secrets management for AI workloads

• Put guardrails in place for data access, model usage, and auditability

• Partner with security and compliance teams to meet enterprise requirements

Leadership & Consulting

• Mentor and direct a Platform Engineer on the engagement

• Lead architecture reviews and write the decision records that outlast the engagement

• Build trust with client engineering leaders and leave their team able to run what we build

Required Qualifications:

• 10+ years in infrastructure, platform, or DevOps engineering

• Deep production experience with Kubernetes, including Azure AKS

• Hands-on experience with GCP

• Expert-level Terraform

• Experience running GPU infrastructure (NVIDIA GPU Operator, node pools, scheduling, or similar)

• Experience building infrastructure that supports LLM workloads in production

• Strong cloud security background: IAM, networking, secrets, policy as code

• Experience leading technical direction for a team

Preferred Qualifications (Exceptional Candidates):

• Experience building an internal agentic AI platform

• Familiarity with model serving (vLLM, Triton, KServe, Ray Serve)

• Experience with Azure OpenAI or Vertex AI

• Consulting or client-facing experience

What Sets Exceptional Candidates Apart:

• You've built a platform other engineering teams chose to adopt

• You've cut GPU spend meaningfully without slowing teams down

• You can explain a platform architecture to a CTO and a junior engineer in the same meeting

What to know before you apply:

• This role will require being in the Chicago office 3 days per week and up to 20% travel within the United States.

• Focused is unable to sponsor or take over sponsorship of the employment Visa process at this time.

• The Chicago base salary range for this role is $185,000 - $225,000.

FAQ

How much does a Senior Platform Engineer, AI Infrastructure at Focused make?

The posted pay for this role is $185k–$225k a year.

How much experience do you need?

The posting asks for 10+ years in infrastructure, platform, or devops engineering. It is a senior-level role.

Does Focused sponsor visas for this role?

The posting says visa sponsorship is not available.

What tools and technologies does the posting mention?

Kubernetes, Azure AKS, GCP GKE, Terraform, GPU Operator, NVIDIA GPU Operator, LLM, IAM, vLLM, Triton, KServe, Ray Serve, Azure OpenAI, Vertex AI, GitOps.