Senior Software Engineer - Dev Platform

• Build and extend the AI Gateway: new model and provider integrations, routing policies, budgets, rate limits, and usage and cost reporting

• Design the APIs, SDKs and self-service tooling that let engineers across Kraken onboard to the gateway quickly and safely

• Help teams migrate their LLM workloads onto the gateway with minimal disruption

• Implement access control, key management and audit logging in partnership with Security

• Instrument the gateway so teams can see latency, errors, token usage and cost for their own workloads

• Own features end to end, from design through production, and keep the service reliable alongside SRE

• Support internal users with clear documentation, debugging help and a tight feedback loop that shapes the roadmap

• Contribute to code review, design documents and engineering practices across Dev Platform

• Solid experience as a backend or platform software engineer building and operating APIs and distributed services in production

• Strong skills in a backend language such as Rust, Python or TypeScript, with a habit of writing well-tested, maintainable code

• Working knowledge of how LLM APIs behave: authentication, streaming responses, token accounting, rate limits and provider failure modes

• Experience with observability, CI/CD and containers, and comfort with Kubernetes and a major cloud provider

• Ability to design clean, well-documented APIs for internal customers and to weigh their feedback

• Clear written and verbal communication, and the ownership to carry work from idea to production

• Experience with API gateways, proxies or traffic management

• Experience building LLM-powered systems, including routing, caching, evaluation or cost controls

• Familiarity with authentication and authorization patterns (OAuth, OIDC, RBAC)

• Contributions to open-source infrastructure or developer-platform projects

Unless a specific application deadline is stated in the job posting, applications are accepted on an ongoing basis. Please note, applicants are permitted to redact or remove information on their resume that identifies age, date of birth, or dates of attendance at or graduation from an educational institution. We consider qualified applicants with criminal histories for employment on our team, assessing candidates in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance.