lm-proxy

by Nayjest · AI Tool · ★ 117

About lm-proxy

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

aianthropicapi-proxyfastapigoogle-ailanguage-modelsllmllm-apillm-gatewayllm-inference

Quick Facts

Stars117
Forks13
LanguagePython
CategoryAI Tool
LicenseMIT
Quality Score40.75/100
Open Issues10
Last Updated2026-04-29
Created2025-05-24
Platformspython
Est. Tokens~100k

More AI Tool Tools

Explore other popular ai tool tools:

View all AI Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is lm-proxy?

lm-proxy is OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.. It is categorized as a AI Tool with 117 GitHub stars.

What programming language is lm-proxy written in?

lm-proxy is primarily written in Python. It covers topics such as ai, anthropic, api-proxy.

How do I install or use lm-proxy?

You can find installation instructions and usage details in the lm-proxy GitHub repository at github.com/Nayjest/lm-proxy. The project has 117 stars and 13 forks, indicating an active community.

What license does lm-proxy use?

lm-proxy is released under the MIT license, making it free to use and modify according to the license terms.

View on GitHub → Browse AI Tool tools