Senior Security Engineer, Product & Platform
Litellm
- San Francisco, CA
- On-site
- Senior level
- 7+ yrs experience
- Security Engineering
- Visa: not specified
- $220k–$280k
The role in 30 seconds
LiteLLM is seeking a Senior Security Engineer to secure its AI Gateway, application, infrastructure, and software delivery pipeline. This hands-on role involves working directly with engineers to improve the security of LiteLLM's Python codebase and build processes, making security an integral part of how software is designed and shipped.
Is this role a fit for you?
The backgrounds this role is most likely to hire from, as RoleStack reads the posting.
Strong match
- B2B infrastructure / API / developer tools
- Software, SaaS & AI Platform
- Internal tooling / back-office systems
- Developers / technical users
- Internal users (employees, ops teams)
Workable stretch
- B2B enterprise platform / workflow software
- Creator / builder / self-serve tool
- Enterprise users (complex workflows, admin panels, role-based access)
- SMB / small business (self-serve, simplicity-focused)
- Enterprise-scale (high availability, compliance, large distributed systems)
Harder transition
- B2C consumer-facing application
- Marketplace / multi-sided platform
- Embedded systems / hardware-adjacent
- Data platform / ML pipeline
- Consumer / general public (high polish, conversion-focused)
Industry: Software, SaaS & AI Platform. See your personal match score
What they're really screening for
Must-haves
- CORE 7+ years of relevant experience, including independent ownership of a security scope.
- CORE Experience hardening a production CI/CD pipeline, including GitHub Actions permissions and keyless signing.
- CORE Strong knowledge of a major cloud provider, preferably AWS, including IAM, secrets management, and workload identity.
- PLUS Familiarity with Terraform.
- CORE Ability to read production Python web-service code, identify vulnerabilities, and implement fixes.
- CORE Experience building security tooling and guardrails that engineering teams adopted.
- CORE Strong judgment about prioritization and risk when several problems need attention at once.
- PLUS Excellent written and verbal communication, including the ability to coordinate across time zones independently.
Nice-to-haves
- PLUS Experience as the first or second security hire at a developer-tools or open-source company.
- CORE A background in software, platform, or infrastructure engineering.
- CORE Experience leading platform or infrastructure security, defining roadmaps, and owning the security of releases.
Résumé keywords for this role
Terms the posting stresses. Include the ones you can honestly back up.
Tools & technologies
- LiteLLM
- AI Gateway
- LLM
- Python
- GitHub Actions
- Terraform
- AWS
- IAM
- keyless signing
Concepts & phrases
- Senior Security Engineer
- Product & Platform
- AI Gateway
- unified interface
- LLM providers
- security lead
- Python codebase
- secure releases
- security part
- San Francisco
- preferred, but
- individual contributor
- own roadmap
- implement improvements
- day-to-day decisions
Words that count as the same thing: "LiteLLM" ≈ AI Gateway, LLM Interface · "Python web-service code" ≈ Python codebase, Python backend code · "CI/CD pipeline" ≈ build and release pipeline · "GitHub Actions permissions" ≈ workflow permissions · "keyless signing" ≈ signing, release integrity
Check my résumé against these keywordsHiring at Litellm
Open senior roles RoleStack tracks right now, posted in the last 30 days.
More open roles at Litellm
- Staff Engineer, AI $250k–$350k
- Staff Engineer, Systems and Reliability $250k–$350k
- Senior Security Operations / Detection Engineer $220k–$280k
Full job description from Litellm
From Litellm's posting. View the original
LiteLLM is an open-source AI Gateway that gives developers a unified interface to LLM providers. We’re looking for a Senior Security Engineer to secure our application, infrastructure, and software delivery pipeline.
ABOUT THE ROLE
This is a hands-on individual contributor role reporting to our security lead. You’ll work directly with engineers to review and harden LiteLLM’s Python codebase, secure releases, and make security part of how we build. San Francisco is preferred, but not required.
Show full description Show less
You’ll own your roadmap, implement improvements yourself, and make day-to-day decisions independently. You should be comfortable prioritizing competing risks and explaining the tradeoffs behind your decisions.
The ideal candidate has built and owned a product, platform, or infrastructure security program and knows how to turn security findings into lasting engineering improvements.
RESPONSIBILITIES
- Review and harden LiteLLM’s Python codebase, fixing vulnerabilities and addressing their underlying causes.
- Review sensitive pull requests and architecture changes before they reach production.
- Harden our build and release pipeline, including GitHub Actions permissions, workload identity, signing, and credential handling.
- Build and maintain automated controls for secrets detection, credential management, and software release integrity.
- Review cloud architecture, IAM, secrets management, and workload identity, and implement security improvements.
- Build guardrails and secure defaults that fit how engineers work.
- Document our security architecture, decisions, and operating practices.
- Own delivery and ongoing maintenance of product and pipeline security improvements.
WHAT WE’RE LOOKING FOR
- 7+ years of relevant experience, including independent ownership of a security scope.
- Experience hardening a production CI/CD pipeline, including GitHub Actions permissions and keyless signing.
- Strong knowledge of a major cloud provider, preferably AWS, including IAM, secrets management, and workload identity.
- Familiarity with Terraform.
- Ability to read production Python web-service code, identify vulnerabilities, and implement fixes.
- Experience building security tooling and guardrails that engineering teams adopted.
- Strong judgment about prioritization and risk when several problems need attention at once.
- Excellent written and verbal communication, including the ability to coordinate across time zones independently.
BONUS POINTS
- Experience as the first or second security hire at a developer-tools or open-source company.
- A background in software, platform, or infrastructure engineering.
- Experience leading platform or infrastructure security, defining roadmaps, and owning the security of releases.
WHY JOIN LITELLM?
- Secure an open-source product, its infrastructure, and its software delivery pipeline.
- Work directly with engineers and influence how software gets designed and shipped.
- Set priorities and implement the improvements you recommend.
- Build security practices that become part of everyday engineering work.
ABOUT LITELLM
LiteLLM provides a unified API for LLM providers, along with routing, authentication, budgets, observability, and governance for production AI systems.
FAQ
How much does a Senior Security Engineer, Product & Platform at Litellm make?
The posted pay for this role is $220k–$280k a year.
How much experience do you need?
The posting asks for 7+ years in security engineering. It is a senior-level role.
Does Litellm sponsor visas for this role?
The posting does not say whether visa sponsorship is available. Ask the recruiter before you apply.
Is this role remote?
It is an on-site role.
What tools and technologies does the posting mention?
LiteLLM, AI Gateway, LLM, Python, GitHub Actions, Terraform, AWS, IAM, keyless signing.