raiyanyahya / how-to-train-your-gpt
Build a modern LLM from scratch. Every line commented. Explained like we are five.
Why this job: says: from scratch; topics: tutorial
What it does
This is a 12-chapter, 7,500+ line interactive textbook that teaches you how to build, train and run a modern language model from absolute scratch. The same family of architecture behind ChatGPT, Claude, LLaMA and Mistral.
Get started
python main.py- Maintenance
- Active
- Last commit 14 days ago
- Stars
- 4,176
- +19 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Jupyter Notebook
- 89% of the code
Is it looked after?
- Contributors
- 1
- Last 90 days
- Issues
- 100% closed
- 0 still open
- Pull requests
- 0 merged
- 1 waiting
- Releases
- None
- Never published
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| rohitg00 / ai-engineering-from-scratch | 77,891 | today | MIT | No downloads |
| shareAI-lab / learn-claude-code | 80,096 | 13 days ago | MIT | No downloads |
| aa1143 / NamiAgent | 454 | 10 days ago | MIT | No downloads |
More: languages, topics and project record
Languages
- Jupyter Notebook 89%
- Python 11%
Topics
- attention-mechanism
- deep-learning
- educational
- from-scratch
- gpt
- language-model
- llama
- llm
- machine-learning
- natural-language-processing
- python
- pytorch
Project record
- JobLists and guides
- StatusListed
- Commits42
- Forks505
- Watching26
- Stars in 28 days+531
- CreatedMay 3, 2026
- First seen by usNov 7, 2026
- CheckedNov 7, 2026