PrismML-Eng / Bonsai-demo
Bonsai Demo
Why this job: topics: llamacpp, mlx
What it does
For the earlier Bonsai 1-bit and Ternary-Bonsai models (27B, 8B, 4B, 1.7B), see Bonsai1_README.md. For troubleshooting, see FAQ.md.
Get started
git clone https://github.com/PrismML-Eng/Bonsai-demo.git
cd Bonsai-demo
./setup.sh ./scripts/run_llama.sh -p "What is the capital of France?" ./scripts/run_mlx.sh -p "What is the capital of France?" - Maintenance
- Active
- Last commit 4 days ago
- Stars
- 3,498
- +23 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Shell
- 44% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 87% closed
- 13 still open
- Pull requests
- 161 merged
- 7 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| fiveoutofnine / whatcanirun | 248 | 2 months ago | MIT | No downloads |
| pythops / tenere | 686 | 6 months ago | GPL-3.0 | Mac, Windows, Linux |
| mlx-node / mlx-node | 167 | today | MIT | Mac |
More: languages, topics and project record
Languages
- Shell 44%
- Python 40%
- PowerShell 16%
Topics
- bonsai
- llm
- prism-ml
- llamacpp
- mlx
- small-models
Project record
- JobLocal LLMs
- StatusListed
- Commits209
- Forks402
- Watching31
- Stars in 28 days+171
- CreatedMar 25, 2026
- First seen by usNov 7, 2026
- CheckedNov 8, 2026