Skip to content

Fix incorrect (1 - b2) coefficient in scale_by_adan#1715

Open
codewithfourtix wants to merge 4 commits into
google-deepmind:mainfrom
codewithfourtix:fix-adan-beta2-coefficient
Open

Fix incorrect (1 - b2) coefficient in scale_by_adan#1715
codewithfourtix wants to merge 4 commits into
google-deepmind:mainfrom
codewithfourtix:fix-adan-beta2-coefficient

Adopt paper beta convention for adan per review

e0bea07
Select commit
Loading
Failed to load commit list.