tokenizer = AutoTokenizer.from_pretrained("WeOpenML/PandaLM-7B-v1",use_fast=False)
Traceback (most recent call last):
File "", line 1, in
File "/data1/.conda/envs/pandalm/lib/python3.9/site-packages/transformers/models/auto/tokenization_auto.py", line 676, in from_pretrained
raise ValueError(
ValueError: Tokenizer class LlamaTokenizer does not exist or is not currently imported.
Should I Run the demo scripts: bash scripts/inst-tune.sh?But running this command takes too much time
tokenizer = AutoTokenizer.from_pretrained("WeOpenML/PandaLM-7B-v1",use_fast=False)
Traceback (most recent call last):
File "", line 1, in
File "/data1/.conda/envs/pandalm/lib/python3.9/site-packages/transformers/models/auto/tokenization_auto.py", line 676, in from_pretrained
raise ValueError(
ValueError: Tokenizer class LlamaTokenizer does not exist or is not currently imported.
Should I Run the demo scripts: bash scripts/inst-tune.sh?But running this command takes too much time