Senior Security Engineer, Product & Platform
San Francisco, United States · On-site · Full-time
- Posted 2w ago
- From LiteLLM’s careers page
- Location
- San Francisco, United States
- Work mode
- On-site
- Type
- Full-time
- Level
- Senior
- Experience
- 7+ years
- Department
- Engineering
Opens the listing on jobs.ashbyhq.com
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
LiteLLM is an open-source AI Gateway that gives developers a unified interface to LLM providers. We’re looking for a Senior Security Engineer to secure our application, infrastructure, and software delivery pipeline.
About the role
This is a hands-on individual contributor role reporting to our security lead. You’ll work directly with engineers to review and harden LiteLLM’s Python codebase, secure releases, and make security part of how we build. San Francisco is preferred, but not required.
You’ll own your roadmap, implement improvements yourself, and make day-to-day decisions independently. You should be comfortable prioritizing competing risks and explaining the tradeoffs behind your decisions.
The ideal candidate has built and owned a product, platform, or infrastructure security program and knows how to turn security findings into lasting engineering improvements.
Responsibilities
- Review and harden LiteLLM’s Python codebase, fixing vulnerabilities and addressing their underlying causes.
- Review sensitive pull requests and architecture changes before they reach production.
- Harden our build and release pipeline, including GitHub Actions permissions, workload identity, signing, and credential handling.
- Build and maintain automated controls for secrets detection, credential management, and software release integrity.
- Review cloud architecture, IAM, secrets management, and workload identity, and implement security improvements.
- Build guardrails and secure defaults that fit how engineers work.
- Document our security architecture, decisions, and operating practices.
- Own delivery and ongoing maintenance of product and pipeline security improvements.
What we’re looking for
- 7+ years of relevant experience, including independent ownership of a security scope.
- Experience hardening a production CI/CD pipeline, including GitHub Actions permissions and keyless signing.
- Strong knowledge of a major cloud provider, preferably AWS, including IAM, secrets management, and workload identity.
- Familiarity with Terraform.
- Ability to read production Python web-service code, identify vulnerabilities, and implement fixes.
- Experience building security tooling and guardrails that engineering teams adopted.
- Strong judgment about prioritization and risk when several problems need attention at once.
- Excellent written and verbal communication, including the ability to coordinate across time zones independently.
Bonus points
- Experience as the first or second security hire at a developer-tools or open-source company.
- A background in software, platform, or infrastructure engineering.
- Experience leading platform or infrastructure security, defining roadmaps, and owning the security of releases.
Why join LiteLLM?
- Secure an open-source product, its infrastructure, and its software delivery pipeline.
- Work directly with engineers and influence how software gets designed and shipped.
- Set priorities and implement the improvements you recommend.
- Build security practices that become part of everyday engineering work.
About LiteLLM
LiteLLM provides a unified API for LLM providers, along with routing, authentication, budgets, observability, and governance for production AI systems.
Compensation
$220K – $280K • Offers Equity
Compensation type: Salary
Minimum: 220000
Maximum: 280000
Currency: USD
Period: 1 YEAR
Compensation type: EquityPercentage
Period: NONE
$220K – $280K • Offers Equity
Compensation: $220K – $280K
Compensation type: Salary
Minimum: 220000
Maximum: 280000
Currency: USD
Period: 1 YEAR
Compensation: Offers Equity
Compensation type: EquityPercentage
Period: NONE
Skills they ask for
Pick one to see other roles that ask for it.
About LiteLLM
AI & Machine LearningLiteLLM is an open-source AI gateway and LLM proxy. It provides a unified API for more than 140 LLM providers, along with routing, authentication, budgets, observability, and governance for production AI systems.
See all 9 roles at LiteLLMMore roles at LiteLLM
See all 9- Staff Backend EngineerSan Francisco · Staff · On-siteEngineering · Staff · On-siteSan Francisco, United States1d
- Senior Backend EngineerSan Francisco · Senior · On-siteEngineering · Senior · On-siteSan Francisco, United States1d
- ML EngineerSan Francisco · On-siteEngineering · On-siteSan Francisco, United States1w
- Head of CS and SupportSan Francisco · Director · On-siteCustomer Service · Director · On-siteSan Francisco, United States1w
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.