llmix

About llmix

Production LLM call layer for AI agents and tools: keep OpenAI/Anthropic/AI SDK/LiteLLM, hot-swap models with MDA presets, and add cache, retries, circuit breakers, key rotation, singleflight, and Python/TypeScript/Rust parity.

ai-agents ai-sdk ai-tools anthropic circuit-breaker gemini key-rotation litellm llm llm-cache

Quick Facts

Stars	132
Forks	28
Language	Python
Category	Agent Tool
License	Apache-2.0
Quality Score	39.3/100
Open Issues	13
Last Updated	2026-10-03
Created	2026-05-09
Platforms	gemini, python
Est. Tokens	~295k

Compatible Skills

These tools work well together with llmix for enhanced workflows:

vmlx — semantic(0.16)+complementary+shared_fw(anthropic,openai)+same_lang+similar_pop+shared_platform (72%)
ToolRegistry — semantic(0.17)+complementary+shared_fw(anthropic,openai)+same_lang+similar_pop+shared_platform (67%)
flama — semantic(0.16)+complementary+shared_fw(anthropic,openai)+same_lang+similar_pop+shared_platform (67%)
litellm — semantic(0.22)+complementary+shared_fw(anthropic,openai)+rare_topics+same_lang+shared_platform (63%)

More Agent Tool Tools

Explore other popular agent tool tools:

skills ⭐ 179.5k
skills ⭐ 175.0k
ponytail ⭐ 166.6k
langflow ⭐ 155.8k
claude-code ⭐ 151.8k
langchain ⭐ 148.0k
system-prompts-and-models-of-ai-tools ⭐ 144.0k
caveman ⭐ 113.6k
learn-claude-code ⭐ 77.7k
OpenMontage ⭐ 68.9k

View all Agent Tool tools →

Popular Python Agent Tools

hermes-agent ⭐ 255.2k · Codex Skill
skills ⭐ 179.5k · Agent Tool
dify ⭐ 158.9k · MCP Server
open-webui ⭐ 156.2k · MCP Server
langflow ⭐ 155.8k · Agent Tool

Frequently Asked Questions

What is llmix?

llmix is Production LLM call layer for AI agents and tools: keep OpenAI/Anthropic/AI SDK/LiteLLM, hot-swap models with MDA presets, and add cache, retries, circuit breakers, key rotation, singleflight, and Pyt. It is categorized as a Agent Tool with 132 GitHub stars.

What programming language is llmix written in?

llmix is primarily written in Python. It covers topics such as ai-agents, ai-sdk, ai-tools.

How do I install or use llmix?

You can find installation instructions and usage details in the llmix GitHub repository at github.com/sno-ai/llmix. The project has 132 stars and 28 forks, indicating an active community.

What license does llmix use?

llmix is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse Agent Tool tools