Skip to content

Use unfused SDPA for short sequences (q_len <= 128 or kv_len <= 128) #24413

Use unfused SDPA for short sequences (q_len <= 128 or kv_len <= 128)

Use unfused SDPA for short sequences (q_len <= 128 or kv_len <= 128) #24413

Annotations

26 errors
Job log options

This job was cancelled