LiteLLM

| TLDR LiteLLM is an open-source LLM Gateway with 28K+ stars on GitHub and trusted by companies like NASA, Rocket Money, Samsara, Lemonade, and Adobe. We’re rapidly expanding and seeking a performance engineer to help scale the platform to handle 5K RPS (Requests per second). We’re based in San Francisco. What is LiteLLM LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format We just hit $2.5M ARR and have raised a $1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund. You can find more information on our website, Github and Technical Documentation. About the Role We're hiring a Python performance engineer to own maximizing throughput, minimizing latency and ensuring our platform is reliable in production. Roadmap for Performance Engineer: By end of this year our RPS and latency overhead should be at parity with industry benchmarks. Cover stream + non-stream for /chat/completions, /completions, /embeddings, /realtime, /audio/transcriptions Reduce e2e overhead latency for cache misses. Currently at 100ms-500ms - ensure we meet industry standards. Reduce e2e overhead latency for cache hits - ensure we meet industry benchmarks. Ensure overhead latency scales well when other components are added to the platform - e.g Redis, Redis Cluster, DB, Non-Admin Virtual Keys Ensure overhead latency scales well with payload size - 1MB prompt with streaming should be sub 100ms Address customer specific and pipeline specific latency issues. e.g. Enterprise customers reporting high overhead - this person should be able to debug these issues, get on support calls and help address any environment specific settings. Address paying customer memory leaks Enterprise clients have ongoing memory leaks that need resolution Longer term - should add coverage over new endpoints - /realtime, /audio/transcriptions/, /audio/speech

| TLDR LiteLLM is an open-source LLM Gateway with 28K+ stars on GitHub and trusted by companies like NASA, Rocket Money, Samsara, Lemonade, and Adobe. We’re rapidly expanding and seeking a founding full-stack engineer to help scale the platform. We’re based in San Francisco. What is LiteLLM LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format We just hit $2.5M ARR and have raised a $1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund. You can find more information on our website, Github and Technical Documentation. Why do companies use LiteLLM enterprise Companies use LiteLLM Enterprise once they put LiteLLM into production and need enterprise features like Prometheus metrics (production monitoring) and need to give LLM access to a large number of people with SSO (secure sign on) or JWT (JSON Web Tokens) What you will be working on Skills: Next.js, Python, TypeScript, User discovery LiteLLM exposes a developer portal, used by admins to grant access to 1k+ developers within their organizations. You will be responsible for: Making sure the UI is stable, and responsive Adding or improving existing management endpoints to support UI functionality (e.g. writing performant endpoints for viewing daily usage) Simplifying UI/UX flows (requires talking to users, understanding what’s confusing and working to simplify it) to support new user onboarding This is a high impact role. You will be working closely with our CEO and CTO. What is our tech stack Backend built on Python, FastAPI. Frontend on Next.js + Typescript + TailwindCSS Who we are looking for You have 1-2 years of experience in frontend or full-stack development and have worked on production grade critical systems You are excited about open source software. You want to talk to our users to understand why they use us and what they require. Experience integrating with / writing backend APIs in Python Knowledge of automated UI testing frameworks Past experience or strong interest in generative AI You have played a key role in maintaining and scaling reliable web apps. You are a hard worker and thrive working in a small and accountable team You are eager to take responsibility for shaping the infrastructure of a rapidly growing development tool.

| About LiteLLM LiteLLM is the world’s most popular AI Gateway used by the largest companies (Adobe, Netflix, NASA, etc.) in the world to give their developers access to LLMs and adjacent services (MCP’s, Vector Stores, etc.). About the role We're looking for a Founding Account Executive with experience in selling developer tools (e.g. gitlab, datadog, etc.) to large companies (>1k+ employees). You’ll own the sales cycle from qualified opportunity to close, working closely with the founders and early sales team. As the first sales hire, you will be working closely with the Founders (ex-Microsoft, ex-Coinbase) to help us transition from a founder-led sales motion to a scalable sales motion as we continue to grow at an exponential rate in 2025. Key Responsibilities Own the Sales Process: Manage the entire sales cycle from qualified lead to close, including discovery, demo, proposal, and negotiation. Drive Revenue: Work with the founders to help LiteLLM hit it’s revenue goals. Customer Feedback Loop: Collaborate with product and engineering by sharing insights from customer conversations. Build Repeatable Processes: Establish repeatable sales processes that will scale as the company grows. Build the Sales Team: As we grow, you will also be responsible for building the future sales team by helping define KPIs, hiring criteria, and culture. Why Work At LiteLLM? You love working with developers (27k+ Github stars) You want to work hard (996 work culture) You want to learn how AI is transforming businesses (Businesses run ALL LLM calls through LiteLLM) You enjoy building things from scratch (defining GTM, sales playbook, hiring) Pay Transparency The annual base salary range for this role is $100,000 - $175,000, with additional commission and on-target earnings Top-tier Medical, Dental, and Vision benefits, including FSA Qualification 2-4+ years of experience in full-cycle B2B sales, ideally in SaaS or tech startups. Experience selling to regulated industries (e.g. insurance, financial services) is a strong plus. Proven track record of meeting or exceeding quota. Excellent communication and storytelling skills, with the ability to tailor messaging to diverse buyer personas. Self-starter who thrives in an early-stage environment and is excited to help build sales processes from the ground up Strong organizational skills, with the ability to manage multiple opportunities through various stages of the sales pipeline. Comfortable with CRM tools, sales automation platforms, and a fast-paced, feedback-driven culture.

| Compensation: $5000/month LiteLLM is hiring a Technical Customer Success Manager to be the bridge between our customers and our product. You'll own the technical support experience, ensure customer success through proactive engagement, and work closely with our engineering team to resolve issues and drive product improvements. This role combines technical problem-solving with relationship management — you'll be the trusted advisor helping customers maximize their success with LiteLLM while providing critical feedback to shape our product roadmap. What you'll do Own and respond to technical support issues from customers using LiteLLM — primarily via Slack, Teams and email Scope support tickets and determine when to escalate bugs or feature requests to the engineering team Reproduce bugs and collaborate closely with Engineering to prioritize and resolve customer issues Conduct weekly 1:1 check-in calls with customers to proactively identify issues and ensure product success What we're looking for Experience in technical customer success, support, or solutions engineering roles (required) Strong technical troubleshooting skills with ability to reproduce and debug complex issues Comfortable with APIs, integrations, and technical concepts related to AI/ML infrastructure Excellent communication skills for both technical and non-technical stakeholders Why LiteLLM? We’ve accelerated revenue 15x last year into 7-figures ARR Our customers include some of the largest companies in the world like Adobe, NASA, Rocket Money, Netflix, IBM, etc. We have a seed stage valuation w/ series A metrics, so now is the best time to join We're a small but talent dense team that includes ex-Microsoft, Coinbase engineers & national record holders

| Compensation: $90K OTE (approx. $60K base + $30K variable) LiteLLM is hiring a Sales Development Representative to be the first point of contact for prospective customers. You’ll run the initial discovery calls, qualify inbound leads, and make sure potential clients understand how LiteLLM can solve their problems. This role is all about opening doors — you’ll help prospects navigate the evaluation process, tee up high-quality opportunities for the CEO and sales team, and ensure our pipeline is strong and growing. Perfect for someone who loves talking to customers, is curious about how AI is transforming business, and wants to play a key role in scaling a breakout AI infrastructure company. What you’ll do Run initial screening and discovery calls with prospective customers Qualify inbound leads and ensure they’re a good fit for LiteLLM Manage and track opportunities in the CRM to keep pipeline clean and organized Work closely with the CEO to hand off qualified leads for deeper technical/sales discussions Follow up with prospects via email/LinkedIn to keep conversations moving forward Provide feedback from customer conversations to help shape product and sales strategy What we’re looking for Interested in high-growth startups Strong communication and listening skills; comfortable running customer calls Experience in a sales, SDR, or customer-facing role (required) Excited about AI and curious to learn the technical side of what we’re building Highly organized, detail-oriented, and able to manage multiple conversations at once Self-motivated and resilient — you’re not afraid to hear “no” and keep going Why LiteLLM? We’ve accelerated revenue 15x last year into 7-figures ARR Our customers include some of the largest companies in the world like Adobe, NASA, Rocket Money, Netflix, IBM, etc. We have a seed stage valuation w/ series A metrics, so now is the best time to join We're a small but talent dense team that includes ex-Microsoft, Coinbase engineers & national record holders