diff --git a/THIRD_PARTY_NOTICE.md b/THIRD_PARTY_NOTICE.md
new file mode 100644
index 00000000..56d8280e
--- /dev/null
+++ b/THIRD_PARTY_NOTICE.md
@@ -0,0 +1,13 @@
+The code in this repository depends on the following third-party libraries:
+
+| Library | License | Link |
+|----------|----------|----------|
+| flash-attn | BSD | https://github.com/Dao-AILab/flash-attention/blob/main/LICENSE |
+| PyTorch | BSD | https://github.com/pytorch/pytorch/blob/main/LICENSE |
+| xformers | BSD | https://github.com/facebookresearch/xformers/blob/main/LICENSE |
+| jaxtyping | MIT | https://github.com/patrick-kidger/jaxtyping/blob/main/LICENSE |
+| einops | MIT | https://github.com/arogozhnikov/einops/blob/main/LICENSE |
+| omegaconf | BSD | https://github.com/omry/omegaconf/blob/master/LICENSE |
+| attrs | MIT | https://github.com/python-attrs/attrs/blob/main/LICENSE |
+| scipy | BSD-3-Clause | https://github.com/scipy/scipy/blob/main/LICENSE.txt<br>https://github.com/scipy/scipy/blob/main/LICENSES_bundled.txt |
+| lightning / torchmetrics | Apache 2.0 | https://github.com/Lightning-AI/torchmetrics/blob/master/LICENSE |