NightMean / OlliteRT

What it does

• Multi-model Support. One-tap download from HuggingFace, import .litertlm files or model lists from local storage, or add custom model sources via JSON file or URL
• Multimodal & Reasoning. Vision, audio, thinking, streaming support, and tool calling (experimental) for capable models
• Benchmark Built-in. Test and compare models on your device to find the best fit for your hardware
• Activity Logs. Detailed request/response logs with search, filtering, and JSON highlighting
• Always On, Low Power. Configurable auto-start on boot, sips ~5-10W vs 300W+ for a GPU server — perfect for that old phone in your drawer*