vmlx

by jjang-ai · MCP Server · ★ 897

About vmlx

MLX Inference Server for Apple Silicon Self-hosted inference server for LLMs, VLMs, and image generation on Apple Silicon. OpenAI + Anthropic + Ollama compatible HTTP API. Self-hosted; no third-party API keys required. Looking for a native Swift macOS app or Swift inference engine? See osaurus.ai. <img src="https://img.shields.i

anthropic-apikvcache-compressionkvcache-optimizationkvcache-reusellmlmstudiomacbookmcp-servermlxmlxllm

Quick Facts

Stars897
Forks96
LanguagePython
CategoryMCP Server
LicenseApache-2.0
Quality Score56.01/100
Open Issues66
Last Updated2026-10-19
Created2026-02-18
Platformsmcp, python
Est. Tokens~11468k

Compatible Skills

These tools work well together with vmlx for enhanced workflows:

  • Rapid-MLX — semantic(0.20)+complementary+shared_fw(ollama,openai)+rare_topics+same_lang+similar_pop+shared_platform (73%)
  • Genspark-AI — semantic(0.16)+complementary+shared_fw(anthropic,ollama,openai)+same_lang+similar_pop+shared_platform (71%)
  • claude-code-local — semantic(0.21)+complementary+shared_fw(anthropic)+rare_topics+same_lang+similar_pop+shared_platform (70%)
  • llmix — semantic(0.16)+complementary+shared_fw(anthropic,openai)+same_lang+similar_pop+shared_platform (67%)
  • mlx-serve — semantic(0.24)+complementary+shared_fw(anthropic,openai)+rare_topics+similar_pop (63%)

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Python Agent Tools

Frequently Asked Questions

What is vmlx?

vmlx is vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm. It is categorized as a MCP Server with 897 GitHub stars.

What programming language is vmlx written in?

vmlx is primarily written in Python. It covers topics such as anthropic-api, kvcache-compression, kvcache-optimization.

How do I install or use vmlx?

You can find installation instructions and usage details in the vmlx GitHub repository at github.com/jjang-ai/vmlx. The project has 897 stars and 96 forks, indicating an active community.

What license does vmlx use?

vmlx is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse MCP Server tools