liteLLM
5· 9 reviews
Since 2023One library to standardize all LLM APIs
Simplify using OpenAI, Azure, Cohere, Anthropic, Replicate, Google LLM APIs. TLDR Call all LLM APIs using the chatGPT format - completion(model, messages) Consistent outputs and exceptions for all LLM APIs Logging and Error Tracking for all models
Launched 20239 reviews
Unified APIAI Infrastructure Tools
What liteLLM looks like
How Users feel about liteLLM
Pros
+ support for custom models (2)
Cons
No major drawbacks reported.
How people rate liteLLM
5
Based on 9 reviews
5
9
4
0
3
0
2
0
1
0
Recent highlights
Ahmed Allam5/528d ago
Big fan of liteLLM: one API for OpenAI/Anthropic/Groq/etc. Makes multi-model stacks painless
Talshyn Nova5/52mo ago
Great library for unifying LLM access across providers, dev/test friendly!
Emre Gucer5/52mo ago
A must for every other project. Makes it 10x easier to switch models
Unified APIAI Infrastructure Tools