library
LiteLLM
Practical multi-LLM proxy but ecosystem isn't mature yet
6.9Overall
Utility7
Onboarding6
Craft7
Niche fit8
Longevity6
Five dimensions scored independently; overall is a weighted average. Scores are only comparable within this same rubric.
Good for
Teams juggling multiple LLM APIs
Not for
Small projects using single provider
Project description
Python proxy for 100+ LLM providers. OpenAI-compatible API, load balancing, spend tracking, fallbacks. Simplify multi-provider infra.
Alternatives
LangChainOpenAI Python Library