When I add in top_p (i.e. nucleus sampling), it breaks the integration test. Not sure why that is. It has been disabled until that can be fixed.
When I add in top_p (i.e. nucleus sampling), it breaks the integration test. Not sure why that is. It has been disabled until that can be fixed.