Skip to content
The Daily Repo

lyogavin / airllm

AirLLM 2.8T LLM inference with single 4GB GPU

Why this job: says: llm inference; topics: llama

Get started

pip install airllm
Maintenance
Active
Last commit today
Stars
42,030
+420 this week
Licence
Apache-2.0
Allows business use
Downloads for
None listed
No release files
Latest version
v4.0.0
Released 2 months ago
Built with
Jupyter Notebook
94% of the code

Is it looked after?

Contributors
8
Last 90 days
Issues
58% closed
111 still open
Pull requests
28 merged
45 waiting
Releases
6
6 in the last year
  • No contributing guide
  • No security policy
  • No code of conduct
More: languages, topics and project record

Languages

  • Jupyter Notebook 94%
  • Python 6%
  • Shell <1%

Topics

  • chinese-nlp
  • finetune
  • generative-ai
  • instruct-gpt
  • instruction-set
  • llama
  • llm
  • lora
  • open-models
  • open-source
  • open-source-models
  • qlora

Project record

  • JobLocal LLMs
  • StatusFeatured
  • Commits434
  • Forks4,328
  • Watching327
  • Stars in 28 days+2,529
  • CreatedJun 12, 2023
  • First seen by usNov 7, 2026
  • CheckedNov 9, 2026

Type to search.

Try