Skip to content

Add deterministic vLLM-Omni release drift audit - #30

Merged
zuiho-kai merged 1 commit into
mainfrom
agent/issue-28-release-drift-audit
Jul 31, 2026
Merged

Add deterministic vLLM-Omni release drift audit#30
zuiho-kai merged 1 commit into
mainfrom
agent/issue-28-release-drift-audit

Conversation

@zuiho-kai

@zuiho-kai zuiho-kai commented Jul 31, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • add /imupdate <local-upstream-repo> [target-tag-or-sha] as the user-facing Codex/Claude/Cursor skill; it derives the old revision from the audited baseline and defaults the target to the upstream checkout's HEAD
  • add a read-only tools/audit_vllm_omni_release.py command that resolves immutable SHAs, compares Git path changes, registry entries, pipeline keys, deploy YAML, knowledge sources, Direct owner routing, and adapter module coverage
  • add a deterministic machine baseline plus stable JSON output, with report-only and enforce modes
  • advance the model catalog and component source pins to v0.26.0rc1 (807db6ef), including Boogu Image, LingBot Video, the Voxtral XPU deploy migration, and renamed CI documentation sources
  • add weekly report-only CI, automatic PR enforcement for baseline updates, manual audit inputs, and a release-maintenance checklist that keeps PR learning separate from release auditing

Why

The existing knowledge validators prove that Markdown structure is valid, but they cannot prove that model catalogs, source paths, routing, or adapter coverage still match an upstream vLLM-Omni release. Several independently maintained pins had already drifted.

The low-level audit reads upstream Git objects and parses registry dicts with Python AST; it never imports upstream code or rewrites knowledge rules. The imupdate skill wraps that evidence collector, lets the host model make bounded knowledge edits, and then reruns enforce mode plus validators.

Validation

  • py -3.13 -m pytest test/test_imupdate_skill.py test/test_release_audit.py test/test_adapters.py test/test_routing.py test/test_knowledge_source.py test/test_skills_scope.py test/test_capabilities.py -q — 57 passed
  • py -3.13 knowledge/tools/check_knowledge_tree.py — 0 errors
  • py -3.13 knowledge/tools/check_wiki_lint.py — 0 errors, 0 warnings
  • skill-creator quick_validate.py plugin/skills/imupdate — valid
  • PowerShell parser accepted install-mcp.ps1; Ruff check and format check passed for the new Python test
  • enforced live audit from 5d44868e to v0.26.0rc1: 679 changed paths, AR +3, Diffusion +2, deploy YAML +6, 0 unexplained issues, RESULT: CLEAN
  • real default /imupdate input resolution against D:\omni\vllm-omni: baseline 807db6ef to checkout HEAD 0c88f8a0, 414 changed paths and 15 drift issues reported in report-only mode

Full-suite validation on Windows remains blocked by existing platform assumptions outside this diff (POSIX path separators/permissions and shell echo execution); the focused #28 surface is green.

Closes #28

@gemini-code-assist

Copy link
Copy Markdown

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

@zuiho-kai
zuiho-kai force-pushed the agent/issue-28-release-drift-audit branch from b96bc59 to 087ac38 Compare July 31, 2026 03:40
@zuiho-kai
zuiho-kai marked this pull request as ready for review July 31, 2026 03:47
@gemini-code-assist

Copy link
Copy Markdown

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

@zuiho-kai
zuiho-kai merged commit cb426ba into main Jul 31, 2026
1 check passed
zuiho-kai added a commit that referenced this pull request Jul 31, 2026
## Summary

Add three deliberate update paths:

1. `/imupdate <local-git-path> [target]` — derive the old SHA from the
baseline, default the new SHA to checkout `HEAD`, run deterministic
audit, let the host model update evidence-backed facts, then enforce.
2. `/imupdate <repository-name-or-alias-or-url> [target]` — let the host
model resolve the canonical repository and version, prefer a configured
or temporary checkout, then enter the same machine-audit path. If
machine audit is unavailable, report model-only analysis and never claim
`CLEAN`.
3. `python tools/audit_vllm_omni_release.py --from ... --to ... --repo
...` — keep the original pure machine-rule interface with no LLM and no
file edits.

Known aliases `vllm-omni`, `vllmomni`, and `vllm omni` resolve to
`vllm-project/vllm-omni`. Target selection refuses silent downgrades
when GitHub's latest stable release is older than an already-audited
prerelease.

The portable installer introduced by #29 now installs all bundled skills
for Codex, Claude Code, and Cursor instead of hard-coding only
`imreview`.

## Validation

- focused installer/release/adapter/routing/knowledge/skill/capability
tests — 59 passed
- `quick_validate.py plugins/infermatrix-copilot/skills/imupdate` —
valid
- Ruff check and format check passed
- knowledge tree — 0 errors; wiki lint — 0 errors, 0 warnings
- plugin manifests parse as valid JSON
- real local-path resolution: baseline `807db6ef` to `D:\omni\vllm-omni`
checkout `HEAD` `0c88f8a0`, 414 changed paths and 15 drift issues
reported
- real alias identity check: `vllmomni` maps to authoritative
`vllm-project/vllm-omni` metadata and the local checkout remote matches
`https://github.com/vllm-project/vllm-omni.git`
- GitHub Actions release audit — passed

This is a UX follow-up to the already-merged #30.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add deterministic vLLM-Omni release drift audit and maintenance workflow

1 participant