#

ollama-cluster

Here is 1 public repository matching this topic...

geeks-accelerator / ollama-herd

Local AI load balancer for Ollama and MLX fleets. Auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

python load-balancer embeddings zero-config fleet-management multimodal fastapi edge-ai apple-silicon llm local-llm ollama ai-gateway ai-infrastructure self-hosted-ai openai-compatible ai-router inference-router ollama-cluster

Updated Jul 25, 2026
Python

Improve this page

Add a description, image, and links to the ollama-cluster topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the ollama-cluster topic, visit your repo's landing page and select "manage topics."