feat(loss): split surrogate (--policy-loss) and IS granularity (--is-level) out of --advantage-estimator#2

EazyReal wants to merge 1 commit into

mainEazyReal/slime:mainfrom

upstream-pr/policy-loss-axisEazyReal/slime:upstream-pr/policy-loss-axisCopy head branch name to clipboard