About this app
LiteLLM provides a simple interface to call various LLMs (like Bedrock, Azure, OpenAI, Cohere, Anthropic, etc.) using the OpenAI SDK format, simplifying integration of different models.
What's New
LiteLLM, a tool for managing LLM API calls, has released several updates, including performance improvements to scale to 200 RPS, file permission controls, support for new models (like Gemini, Claude-4, Grok-3), enhanced PII masking features, spend logs retention options, and better UI for managing LLM interactions.