Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 30.7k 7.4k

2. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   Python 14.2k 2.6k

3. NVIDIA/cutlass NVIDIA/cutlass Public

   CUDA Templates and Python DSLs for High-Performance Linear Algebra

   C++ 10.1k 2k