Nyvide Akasha

Nyvide Akasha is a family of tiny, quantum-inspired LLMs with complex-valued embeddings and a hybrid output layer.

Project Structure

• nyvide_akasha/akasha_core: Core model components (Embeddings, Attention, Blocks, Output).
• nyvide_akasha/training: Training loop and utilities.
• configs/: Hydra configuration files.
• scripts/: Entry points for training and evaluation.

Installation

This project uses pyproject.toml for dependency management.

pip install .

Running the Training Loop

To run a smoke test of the training loop with dummy data:

python scripts/train_akasha.py train.max_steps=100

You can override configuration parameters from the command line:

python scripts/train_akasha.py model.d_model=128 train.batch_size=4