Transformer

An implementation of a Transformer using PyTorch. Here are some blog posts I wrote that helped me better understand the Transformer architecture.

Reference

• Attention is All You Need, 2017 - Google
• Transformer Explainer
• Transformer: PyTorch Implementation of "Attention Is All You Need"