algorithmicsuperintelligence / optillm
Optimizing inference proxy for LLMs
Why this job: topics: agentic-workflow, agentic-framework, agents, agentic-ai, agent
What it does
- Instant improvements. 2-10x better accuracy on math, coding, and logical reasoning
- Drop-in replacement. Works with any OpenAI-compatible API endpoint
- 20+ optimization techniques. From simple best-of-N to advanced MCTS and planning
- Zero training required. Just proxy your existing API calls through OptiLLM
- Production ready. Used in production by companies and researchers worldwide
Get started
pip install optillm
export OPENAI_API_KEY="your-key-here"
optillm- Maintenance
- Active
- Last commit 7 days ago
- Stars
- 4,340
- +5 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.4.1
- Released 7 days ago
- Built with
- Python
- 100% of the code
Is it looked after?
- Contributors
- 7
- Last 90 days
- Issues
- 86% closed
- 14 still open
- Pull requests
- 192 merged
- 6 waiting
- Releases
- 102
- 18 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| neuron-core / neuron-ai | 2,169 | 4 days ago | MIT | No downloads |
| keta1930 / agent-graph | 237 | 29 days ago | Apache-2.0 | No downloads |
| alirezadir / Agentic-AI-Systems | 503 | 4 months ago | MIT | No downloads |
More: languages, topics and project record
Languages
- Python 100%
- Shell <1%
- Dockerfile <1%
Topics
- agent
- agentic-ai
- agentic-workflow
- agents
- api-gateway
- genai
- large-language-models
- llm
- llm-inference
- llmapi
- mixture-of-experts
- moa
Project record
- JobAgent frameworks
- StatusListed
- Commits964
- Forks400
- Watching40
- Stars in 28 days+30
- CreatedAug 22, 2024
- First seen by usNov 7, 2026
- CheckedNov 9, 2026