[feature request] integration with kubernetes with fractional memory allocation

[meetzuber]

Hi

Is it possible to integrate genv with kubernetes to allocate fraction VRAM to pods and share GPU?
This will be a great integration as most of the workload are running on kubernetes these days.

Thanks

[davidLif]

Hi,
Currently, we do not plan to integrate genv with k8s. However, you can check out https://github.com/NVIDIA/KAI-Scheduler. KAI does have support for fractional gpu memory allocation on k8s.