skyzh / tiny-llm
learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
Why this job: topics: course
What it does
The course begins with array and matrix operations, then introduces kernels and serving machinery as the running model needs them. Keeping the implementation small enough to read end to end makes it possible to connect the equations to memory traffic, kernel occupancy, KV-cache growth, batching, and request scheduling.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 2 days ago
- Stars
- 5,692
- +44 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Python
- 82% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 69% closed
- 8 still open
- Pull requests
- 230 merged
- 0 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| WangRongsheng / awesome-LLM-resources | 9,069 | 8 days ago | Apache-2.0 | No downloads |
| rohitg00 / ai-engineering-from-scratch | 77,891 | today | MIT | No downloads |
| bryanyzhu / agentic-ai-system-course | 681 | 4 months ago | MIT | No downloads |
More: languages, topics and project record
Languages
- Python 82%
- Metal 9%
- C++ 9%
- CMake <1%
Topics
- course
- large-language-model
- llm
- python
- qwen
- serving
- vllm
Project record
- JobLists and guides
- StatusListed
- Commits357
- Forks526
- Watching34
- Stars in 28 days+325
- CreatedApr 19, 2025
- First seen by usNov 7, 2026
- CheckedNov 8, 2026