Every AI assistant today sends your data to the cloud — your questions, your context, your private information. Aios doesn't.
It runs a full LLM inference engine locally via Ollama, sits as a floating bubble on your desktop, and responds to natural language queries entirely on your machine.
Built before "local AI" was a buzzword.
| Feature | Description |
|---|---|
| 🔒 100% Offline | All inference runs locally via Ollama — zero network requests |
| 🫧 Floating Bubble UI | Always-on-top draggable bubble for instant access |
| 💬 Natural Language Chat | Full chat UI built with PySide6/Qt |
| 🧠 Pluggable Brain | Modular agent/router architecture — swap LLMs or add skills |
| ⚡ Graceful Fallbacks | Works even if model or brain is temporarily unavailable |
| 🔧 Configurable | Change the LLM model in one line in llm.py |
User Input
│
▼
bubble.py ──► ui.py (Chat UI)
│
▼
agent.py (Router)
│
▼
brain.py (Logic + Safeguards)
│
▼
llm.py (Ollama wrapper)
│
▼
Local LLM Model
(runs on your GPU/CPU)
Files:
app.py— Entry point, starts the Qt appbubble.py— Always-on-top floating bubble widgetui.py— Main chat interfaceagent.py— Routes user input to the brainbrain.py— Input sanitization + LLM callsllm.py— Thin Ollama wrapper
- Python 3.10+
- Ollama installed and running
- Any Ollama model pulled (e.g.
ollama pull llama3.2)
git clone https://github.com/harshitgavita-07/Aios.git
cd Aios
pip install -r requirements.txt
python app.pyA floating bubble will appear on your desktop. Click it to open the assistant.
2025 is the year of on-device AI:
- Apple Intelligence runs on-device
- Meta's LLaMA models run on consumer hardware
- Privacy regulations are getting stricter globally
Aios was built with this philosophy from day one: your AI, your machine, your data.
- Voice input / TTS output
- System prompt customization via UI
- Plugin system for custom skills (web search, calendar, etc.)
- Hotkey to summon the assistant from anywhere
- Memory / conversation history persistence
Star ⭐ if you believe AI should stay on your machine.
Built by Harshit Gavita