a llm-friendly language
-
Updated
May 15, 2026 - Shell
a llm-friendly language
Scripts to pre train a Multi Tokenizer and also evaluate the performance.
Add a description, image, and links to the for-ai topic page so that developers can more easily learn about it.
To associate your repository with the for-ai topic, visit your repo's landing page and select "manage topics."