mlx-llm

by riccardomusmeci · Agent Tool · ★ 459

About mlx-llm

Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.

llamallmmistralmlxphitransformers

Quick Facts

Stars459
Forks28
LanguagePython
CategoryAgent Tool
Quality Score40.25/100
Last Updated2025-01-29
Created2023-12-07
Platformspython
Est. Tokens~127k

Compatible Skills

These tools work well together with mlx-llm for enhanced workflows:

  • vllm-mlx — semantic(0.36)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)
  • universal-intelligence — semantic(0.17)+complementary+rare_topics+same_lang+similar_pop+shared_platform (60%)
  • BambooAI — semantic(0.15)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)
  • coderunner — semantic(0.24)+complementary+same_lang+similar_pop+shared_platform (53%)
  • mxcp — semantic(0.17)+complementary+same_lang+similar_pop+shared_platform (51%)

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is mlx-llm?

mlx-llm is Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.. It is categorized as a Agent Tool with 459 GitHub stars.

What programming language is mlx-llm written in?

mlx-llm is primarily written in Python. It covers topics such as llama, llm, mistral.

How do I install or use mlx-llm?

You can find installation instructions and usage details in the mlx-llm GitHub repository at github.com/riccardomusmeci/mlx-llm. The project has 459 stars and 28 forks, indicating an active community.

View on GitHub → Browse Agent Tool tools