L
LiteLLM
Universal LLM API gateway for 200+ providers — 38K+ stars
Open SourceFree
Install
pip install litellmAbout
LiteLLM provides a unified OpenAI-compatible API for 200+ LLM providers (OpenAI, Anthropic, Google, Azure, AWS Bedrock, Ollama, and more). Use one interface to call any model, with built-in load balancing, fallbacks, spend tracking, and rate limiting. Essential infrastructure for multi-model agent systems.
Details
| Language | python |
| Patterns | api-gateway, proxy, load-balancing, multi-model |
| Install | pip install litellm |
Tags
api-gatewaymulti-modelproxyload-balancingpythonopen-source
Quick Info
- Organization
- BerriAI
- Pricing
- open-source
- Free Tier
- Yes
- Updated
- Apr 1, 2026
41.8Ktoday392
Also in Frameworks
L
LangChain
Build context-aware reasoning applications with LLMs
OSSFree
LangChain AI
131.9K850.0K/wtoday469
A
AutoGen
Microsoft's framework for building multi-agent AI systems
OSSFree
Microsoft
56.5K3d ago444
C
CrewAI
Multi-agent orchestration framework for collaborative AI workflows
OSSFree
CrewAI Inc
47.7Ktoday284