How to create custom examples

[jan-fischer-hawhamburg]

Hello,

im looking into a way to create customs example (especially because im using a german gpt2-small) but i can't figure where and how to save the data from the model.

Could give me a hint?

[MonoEven]

You should go to huggingface to download "gpt2/tokenizer.json" & "gpt2/tokenizer_config.json".
Then create dir "models/Xenova/gpt2" under "~/transformer-explainer".
And put two jsons into the dir, then you can custom your example.
That's all enough.

Hello,

im looking into a way to create customs example (especially because im using a german gpt2-small) but i can't figure where and how to save the data from the model.

Could give me a hint?

[linwhitehat]

You should go to huggingface to download "gpt2/tokenizer.json" & "gpt2/tokenizer_config.json". Then create dir "models/Xenova/gpt2" under "~/transformer-explainer". And put two jsons into the dir, then you can custom your example. That's all enough.

Hello,
im looking into a way to create customs example (especially because im using a german gpt2-small) but i can't figure where and how to save the data from the model.
Could give me a hint?

Hi,
I would like to try more open source large models, is it the same setup? Is it also ok if the model is fine-tuned on new data?