How long does it take to finetune CogACT?

[jibby2803]

Hi, I am trying to finetune CogACT on fractal dataset. Can anyone help me to answer following question?

• How long does it take to finetune CogACT on fractal20220817_data dataset?
• How many epochs shoud I trained on this datasets?

[arnoldland]

I remember that finetuning on fractal20220817_data with a batch size of 256 for around 80k steps was already sufficient.