How can this model be deployed on multiple GPUs? Or increase the batchsize for faster generation.

[WHUminghui]

I observed that this is only deployed on one GPU and doesn't take up all of the GPU memory, which is too slow for me. May I ask how to speed it up？ Thanks!

[yvfan4]

Could you tell me how many amino acids you have and the gpu memory taken by that amount of amino acids? Thank you. This is important for me to choose which gpu to buy.

[WHUminghui]

The protein I wanted to generate was set to 120 amino acids, using a NVIDIA GeForce RTX 4090 with 24 G graphics memory, which is perfectly adequate.