Nayjest / lm-proxy
OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.
Why this job: says: llm proxy, openai compatible; topics: llm-gateway, llm-proxy, openai-api, proxy, llm-api
What it does
- Provider Agnostic. Connect to OpenAI, Anthropic, Google AI, local models, and more using a single API
- Unified Interface. Access all models through the standard OpenAI API format
- Dynamic Routing. Route requests to different LLM providers based on model name patterns
- Stream Support. Full streaming support for real-time responses
- API Key Management. Configurable API key validation and access control
Get started
pip install lm-proxy- Maintenance
- Active
- Last commit 2 months ago
- Stars
- 160
- +3 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v3.3.2
- Released 2 months ago
- Built with
- Python
- 98% of the code
Is it looked after?
- Contributors
- 1
- Last 90 days
- Issues
- 62% closed
- 10 still open
- Pull requests
- 45 merged
- 13 waiting
- Releases
- 19
- 12 in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| katanemo / plano | 7,112 | 16 days ago | Apache-2.0 | Mac, Linux |
| lidge-jun / opencodex | 18,309 | today | MIT | Mac, Windows, Linux |
| vibe-coding-labs / JoyCode2Api | 218 | 3 months ago | Apache-2.0 | Mac, Linux |
More: languages, topics and project record
Languages
- Python 98%
- Dockerfile 2%
- Makefile 1%
Topics
- ai
- anthropic
- api-proxy
- fastapi
- google-ai
- language-models
- llm
- llm-api
- llm-gateway
- llm-inference
- llm-proxy
- openai
Project record
- JobModel gateways
- StatusListed
- Commits302
- Forks17
- Watching10
- Stars in 28 days+5
- CreatedMay 24, 2025
- First seen by usNov 7, 2026
- CheckedNov 7, 2026