Problem
A model returning a short chat completion does not prove that it supports streaming, tool calls, structured JSON, multimodal input, the Responses API, or the Anthropic Messages bridge.
Scope
- Define a small provider/model conformance matrix for supported protocol features.
- Add bounded canaries for chat, streaming, tool calls, JSON output, vision where advertised, Responses API translation, and Anthropic Messages translation.
- Record feature-level verification separately from basic model health.
- Route feature-specific requests only to targets that have passed that feature or are explicitly pinned by the user.
- Preserve per-model failures and serving provenance in reports.
- Re-run canaries after model-ID or adapter changes.
Acceptance criteria
Related: #1 and #6.
Problem
A model returning a short chat completion does not prove that it supports streaming, tool calls, structured JSON, multimodal input, the Responses API, or the Anthropic Messages bridge.
Scope
Acceptance criteria
Related: #1 and #6.