mlx-serve

by ddalcu · Agent Tool · ★ 64

About mlx-serve

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.

agentanthropic-apiapple-siliconclaude-codeinferencelanguage-modelllmlocal-llmmacosmacos-app

Quick Facts

Stars64
Forks1
LanguageZig
CategoryAgent Tool
LicenseMIT
Quality Score38.75/100
Open Issues1
Last Updated2026-05-18
Created2026-02-17
Platformsclaude-code
Est. Tokens~530k

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Zig Agent Tools

Frequently Asked Questions

What is mlx-serve?

mlx-serve is Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.. It is categorized as a Agent Tool with 64 GitHub stars.

What programming language is mlx-serve written in?

mlx-serve is primarily written in Zig. It covers topics such as agent, anthropic-api, apple-silicon.

How do I install or use mlx-serve?

You can find installation instructions and usage details in the mlx-serve GitHub repository at github.com/ddalcu/mlx-serve. The project has 64 stars and 1 forks, indicating an active community.

What license does mlx-serve use?

mlx-serve is released under the MIT license, making it free to use and modify according to the license terms.

View on GitHub → Browse Agent Tool tools