Skip to content

Fix causal+sliding window mask alignment for autoregressive decode#185

Open
juliantorr-es wants to merge 1 commit into
ROCm:tridaofrom
juliantorr-es:fix/causal-mask-alignment-sliding-window
Open

Fix causal+sliding window mask alignment for autoregressive decode#185
juliantorr-es wants to merge 1 commit into
ROCm:tridaofrom
juliantorr-es:fix/causal-mask-alignment-sliding-window

fix: use top-left mask alignment for causal+sliding window attention

98d39b8
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs