Pinned Loading

1. llama.cpp-omni llama.cpp-omni Public

   Forked from tc-mb/llama.cpp-omni

   Omni inference in C/C++

   C++ 1

2. vllm-omni vllm-omni Public

   Forked from tc-mb/vllm-omni

   A framework for efficient model inference with omni-modality models

   Python

3. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   Python 14.3k 2.6k

4. csapp-proxy csapp-proxy Public

   C

5. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

6. OpenSQZ/MiniCPM-V-CookBook OpenSQZ/MiniCPM-V-CookBook Public

   Cook up amazing AI applications effortlessly with MiniCPM / MiniCPM-V / MiniCPM-o

   Python 612 79