Transformer

Projet Transformers 2024

Implementation of GPT-2

Getting Started

python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
__pycache__		__pycache__
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
attn.png		attn.png
dataset.py		dataset.py
generate_datasets.py		generate_datasets.py
model.py		model.py
requirements.txt		requirements.txt
run.py		run.py
tests.ipynb		tests.ipynb