mizorewww / laya-mlx
Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.
Why this job: topics: apple-silicon, inference, local-ai, mlx
What it does
Laya answers constrained questions (pick an option, score against a rubric, judge true or false) with calibrated probabilities from one bidirectional forward pass. It generates no tokens and returns no JSON to parse. This package runs the original Laya weights in MLX, without PyTorch, Transformers or a cloud API.
Get started
pip install laya-mlx- Maintenance
- Active
- Last commit 11 days ago
- Stars
- 7,079
- +29 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.6.0
- Released 11 days ago
- Built with
- Python
- 100% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 100% closed
- 0 still open
- Pull requests
- 2 merged
- 1 waiting
- Releases
- 4
- 4 in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| jundot / omlx | 23,475 | 4 days ago | Apache-2.0 | Mac |
| Neywa-Labs / nativ | 1,581 | today | MIT | Mac |
| vllm-project / vllm-metal | 1,974 | today | Apache-2.0 | Mac |
More: languages, topics and project record
Languages
- Python 100%
Topics
- apple-silicon
- inference
- machine-learning
- mlx
- modernbert
- decision-model
- laya
- local-ai
- system-one
- typed-decisions
Project record
- JobLocal LLMs
- StatusFeatured
- Commits31
- Forks574
- Watching21
- Stars in 28 days+217
- CreatedSep 19, 2026
- First seen by usNov 7, 2026
- CheckedNov 8, 2026