Pretraining

In this repository I pretrain a language model built from scratch similar in architecture to GPT2.

Name		Name	Last commit message	Last commit date
Latest commit History 21 Commits
code		code
outputs/graphs		outputs/graphs
.gitignore		.gitignore
README.md		README.md
tester.py		tester.py

Provide feedback