tetherto / qvac
Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.
Why this job: says: gguf; topics: local-llm, llm-inference, local-ai, on-device-ai, llama
What it does
Load a model and run inference locally in a few steps. Pick your path.
Get started
mkdir qvac-examples
cd qvac-examples
npm init -y && npm pkg set type=module- Maintenance
- Active
- Last commit 2 days ago
- Stars
- 755
- +11 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- 2 systems
- Mac, Linux
- Latest tag
- sdk-v0.23.0
- Released 7 days ago
- Built with
- TypeScript
- 36% of the code
Is it looked after?
- Contributors
- 29
- Last 90 days
- Issues
- 90% closed
- 18 still open
- Pull requests
- 4,016 merged
- 100 waiting
- Releases
- 38
- 30+ in the last year
- Contributing guide (opens in new tab)
- Security policy (opens in new tab)
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| zeraix / zeraix | 403 | 21 days ago | Apache-2.0 | Mac, Windows |
More: download files, languages, topics and project record
Download files, sdk-v0.23.0
- Mac1 file, 2 downloads
- Linux2 files, 5 downloads
Languages
- TypeScript 36%
- JavaScript 24%
- C++ 21%
- Python 10%
Topics
- local-ai
- ai-sdk
- decentralized-ai
- llama
- llm-inference
- local-fine-tuning
- local-llm
- nodejs
- on-device-ai
- open-source-ai
- open-source-llm
- open-source-rag
Project record
- JobLocal LLMs
- StatusFeatured
- Commits3,570
- Forks156
- Watching7
- Stars in 28 days+69
- CreatedJan 3, 2026
- First seen by usNov 7, 2026
- CheckedNov 9, 2026