Skip to content

Add opt-in hostPath-backed model storage with per-node download DaemonSet#1660

Open
aleskandro wants to merge 1 commit into
llm-d:mainfrom
aleskandro:host-path-volume-wva
Open

Add opt-in hostPath-backed model storage with per-node download DaemonSet#1660
aleskandro wants to merge 1 commit into
llm-d:mainfrom
aleskandro:host-path-volume-wva

Conversation

@aleskandro

Copy link
Copy Markdown
Contributor

When storage.hostPath.enabled: true is set in a scenario, the benchmark creates a static PV backed by a node-local directory and binds the model PVC to it. A DaemonSet downloads the model to every target node (replacing the single download Job), so serving pods always find weights on local disk regardless of scheduling.

Resolves #1433

@aleskandro

Copy link
Copy Markdown
Contributor Author

/cc @asm582

…nSet

When `storage.hostPath.enabled: true` is set in a scenario, the
benchmark creates a static PV backed by a node-local directory and
binds the model PVC to it. A DaemonSet downloads the model to every
target node (replacing the single download Job), so serving pods
always find weights on local disk regardless of scheduling.

Signed-off-by: aleskandro <adistefa@redhat.com>
@aleskandro
aleskandro force-pushed the host-path-volume-wva branch from 2e0516a to 6a9cc85 Compare July 22, 2026 10:33
@Vezio

Vezio commented Jul 24, 2026

Copy link
Copy Markdown
Collaborator

Looks pretty good, going to let CICD run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: Add hostpath config to solve an issue with cold start

2 participants