You must be logged in to sponsor lightseekorg
Become a sponsor to LightSeek Foundation
We created TokenSpeed, TorchSpec and SMG. LightSeek Foundation exists to accelerate the development of open, efficient, and trustworthy AI systems—so that progress in AI benefits everyone, not just a few.
Featured work
-
lightseekorg/tokenspeed
TokenSpeed is a speed-of-light LLM inference engine.
Python 1,525 -
lightseekorg/smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing,…
Rust 363 -
lightseekorg/TorchSpec
A PyTorch native library for training speculative decoding models
Python 181