litellm

by BerriAI · MCP Server · ★ 48.0k

About litellm

🚅 LiteLLM Call 100+ LLMs in OpenAI format. [Bedrock, Azure, OpenAI, VertexAI, Anthropic, Groq, etc.] LiteLLM Proxy Server (AI Gateway) Enterprise Tier </

ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmops

Quick Facts

Stars47,954
Forks8,262
LanguagePython
CategoryMCP Server
Quality Score48.092/100
Open Issues3282
Last Updated2026-05-22
Created2023-07-27
Platformsmcp, python
Est. Tokens~70426k

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Python Agent Tools

Frequently Asked Questions

What is litellm?

litellm is Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropi. It is categorized as a MCP Server with 48.0k GitHub stars.

What programming language is litellm written in?

litellm is primarily written in Python. It covers topics such as ai-gateway, anthropic, azure-openai.

How do I install or use litellm?

You can find installation instructions and usage details in the litellm GitHub repository at github.com/BerriAI/litellm. The project has 48.0k stars and 8262 forks, indicating an active community.

View on GitHub → Browse MCP Server tools