[QUESTION] CUDA Graph Support Inquiry

[StepyHan]

Hi, I'm wondering if ShadowKV currently supports CUDA Graphs. If not, are there plans to add support in the future?

Thanks for your help!

[preminstrel]

Hi @StepyHan,
I think it should be easy to integrate CUDA Graph based on our current codebase. We don't have it yet because we've observed that CPU kernel launches are not a bottleneck for long-context decoding settings. However, you can definitely add it.