Docker image to run a self-hosted text embeddings and reranking server powered by Hugging Face TEI, with an OpenAI-compatible API. Supports BGE, Nomic, MiniLM and other models. Features optional reranking via cross-encoder models, API key auth, model management, offline/air-gapped mode, and persistent model cache.

Docker Compose stack for scalable TEI embeddings (multi-GPU) fronted by a FastAPI proxy with a Qdrant cache. 🐳⛓️💾

Repository of the project Efficient Edge Embeddings (E*3) project, subgrant 2dAI2OC07 from EU Horizon dAIEDGE

Text Embeddings Inference (TEI)'s unofficial python wrapper library for batch processing with asyncio

It will automatically batch inference requests from independent users in a single batch request for efficiency, so that for users the interface looks like individual requests, but internally it is handled as a batch request

An enterprise-grade RAG Chatbot built with AI-assisted development. Features local LLMs (Ollama), LlamaIndex integration, and Entra ID SSO. Designed for secure, air-gapped PDF analysis. 📄

Production-ready self-hosted RAG stack. BGE-M3 embeddings on-premise, pgvector similarity search, FastAPI ingest+query API. No cloud embedding costs.

Local inference engine