litellm

by BerriAI · MCP Server · ★ 55.9k

About litellm

🚅 LiteLLM Call 100+ LLMs in OpenAI format. [Bedrock, Azure, OpenAI, VertexAI, Anthropic, Groq, etc.] LiteLLM Proxy Server (AI Gateway) Enterprise Tier </

ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmops

Quick Facts

Stars55,853
Forks10,411
LanguagePython
CategoryMCP Server
Quality Score63.6600777730429/100
Open Issues4808
Last Updated2026-08-08
Created2023-07-27
Platformsmcp, python
Est. Tokens~19k

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Python Agent Tools

Frequently Asked Questions

What is litellm?

litellm is The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi. It is categorized as a MCP Server with 55.9k GitHub stars.

What programming language is litellm written in?

litellm is primarily written in Python. It covers topics such as ai-gateway, anthropic, azure-openai.

How do I install or use litellm?

You can find installation instructions and usage details in the litellm GitHub repository at github.com/BerriAI/litellm. The project has 55.9k stars and 10411 forks, indicating an active community.

View on GitHub → Browse MCP Server tools