Pinned Loading

1. sparkinfer sparkinfer Public

   Forked from local-inference-lab/sparkinfer

   Python

2. vllm vllm Public

   Forked from local-inference-lab/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. inference-runtime-profiles inference-runtime-profiles Public

   Portable, privacy-safe runtime profiles for reproducible GPU inference deployments

   Python 1

4. vllm-observer vllm-observer Public

   Drop-in, read-only observability dashboard for vLLM workloads

   Python