Pinned Loading

1. EricLBuehler/candle-vllm EricLBuehler/candle-vllm Public

   Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

   Rust 673 82

2. xinfer xinfer Public

   Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.

   Rust 255 33

3. EnflameTechnology/vllm-gcu EnflameTechnology/vllm-gcu Public

   Python 39 10

4. EnflameTechnology/candle-vllm-gcu EnflameTechnology/candle-vllm-gcu Public

   Python 5 3

5. attention.rs attention.rs Public

   LLM Kernel Library for Rust

   Cuda 23 13

6. xbot xbot Public

   A minimal Rust AI agent for vibe coding and task automation

   Rust 4