Transformers

This repository consists the codes for the implementation of

• BERT
• RoBERTa
• XLnet for training on stance classification task on twitter data.

Setup

• Install Anaconda or Miniconda Package Manager
• Create a new virtual environment and install packages.
• conda create -n transformers python pandas tqdm
• conda activate transformers
• conda install -c anaconda scipy
• conda install -c anaconda scikit-learn
• pip install transformers
• pip install tensorboardx
• Install simpletransformers
• pip install simpletransformers