LiteLLM
by LiteLLM
At a glance
Open-source AI gateway and Python SDK providing a consistent interface across model providers.
gateway developer-tools
- Licence
- Not recorded
- Category
- Platforms & Infrastructure
- Business model
- Open (open weights/source)
- Availability
- Not recorded
- Launched
- Not recorded
Overview
Typical uses include Routing of model API requests; Governance of AI usage and spending. Documented capabilities: OpenAI-format access to multiple model providers; Virtual keys, budgets and spend tracking; Request routing, fallbacks and observability callbacks.
Compare this tool Suggest a correction
Key features
- OpenAI-format access to multiple model providers
- Virtual keys, budgets and spend tracking
- Request routing, fallbacks and observability callbacks
Use cases
- Routing of model API requests
- Governance of AI usage and spending
Pricing
The open-source gateway is free to self-host. Enterprise is licensed by annual request capacity, architecture and support rather than per model token; underlying model-provider charges and self-hosted infrastructure remain separate.
Record details
Provenance, dates and links are kept here so the main sections stay about the product itself.
Links, dates and provenance
- Record updated
- 2026-11-03
- Pricing
- www.litellm.ai ↗
- Documentation
- docs.litellm.ai ↗
- Canonical URL
- https://globalaiproductindex.com/products/litellm/
Selection profile
Every field says where its value comes from. "Unknown" means we have not confirmed it — it does not mean the product lacks the feature.
Selection profile11 fields6 unknown
- Tasks it fits
- Automation agents
Editorial classification of the documented features; not a product-performance test.
Suggest a correction - How you use it
- API
Editorial classification of the documented features; not a product-performance test.
Suggest a correction - Runs on
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Where it runs
- Self-hosted
Editorial classification of the documented features; not a product-performance test.
Suggest a correction - Works offline
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Official service region
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Public API
- Yes
Editorial classification of the documented features; not a product-performance test.
Suggest a correction - Licence
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Commercial use
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Interface languages
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Billing
- Open source Enterprise quote Free allowance: Yes Subscription required: No
Prices are the vendor’s advertised entry price and exclude taxes; always confirm on the vendor’s own page.
Suggest a correction
Where each value comes from
- Tasks it fits
- Our inference
- How you use it
- Our inference
- Runs on
- Unknown
- Where it runs
- Our inference
- Works offline
- Unknown
- Official service region
- Unknown
- Public API
- Our inference
- Licence
- Unknown
- Commercial use
- Unknown
- Interface languages
- Unknown
Key facts and their evidence
Each fact lists the conditions it holds under, the page it was read from and the day it was checked.
-
Capability: OpenAI-format access to multiple model providers Verified 2026-11-03 docs.litellm.ai ↗
Suggest a correction
Frequently asked questions
Where does LiteLLM fit in a workflow?
Open-source AI gateway and Python SDK providing a consistent interface across model providers. OpenAI-format access to multiple model providers.
What costs and limits should I compare before choosing LiteLLM?
The open-source gateway is free to self-host. Enterprise is licensed by annual request capacity, architecture and support rather than per model token; underlying model-provider charges and self-hosted infrastructure remain separate.
Similar products
- Prisma AIRS AI Gateway — AI gateway formerly known as Portkey for routing, observing and governing model traffic.
- Activepieces — Workspace combining AI agents, visual flows, tables and application connections.
- Agenta — Team workspace for creating AI coworkers and scheduled or event-triggered automations through chat.
- Agentforce — Salesforce's enterprise AI agent platform for building, testing, and running autonomous agents across service, sales, and employee workflows.
- Agno — Agent SDK and AgentOS runtime for combining agents into durable services, teams and workflows.
- Aisera — Enterprise service agents now offered and supported by Automation Anywhere.
All LiteLLM alternatives → · All Platforms & Infrastructure products →
Sources
- LiteLLM — official product ↗
- LiteLLM — official documentation and terms ↗
- LiteLLM — official documentation and terms ↗
This record was last reviewed on 2026-11-03.
Machine-readable record: /api/products/litellm.json · Spot an error? Suggest a correction