Go implementation of the XET content-addressable storage protocol for large-file transfer with chunk-level deduplication.
This project tracks:
- huggingface/xet-core (reference behavior in production)
- XET Protocol Draft (public protocol baseline)
The Rust implementation in xet-core is currently ahead of the draft in several areas, so this repository prioritizes compatibility with real xet-core behavior where needed.
Implemented in this repository:
- Core hash / gearhash / merkle primitives
- Shard and xorb encode/decode paths
- Upload and download client workflows
- CAS server implementation for local or self-hosted usage
- Hugging Face token/LFS based integration helpers
- Conformance and unit tests for key protocol paths
- This project aims to follow the draft spec where possible.
- When draft and xet-core behavior diverge, practical interop with xet-core may take priority.
- Test and conformance coverage is evolving with protocol and upstream changes.
Licensed under the MIT License. See LICENSE for the full license text.