Skip to content

docs: refresh demo evaluation notes and provider guidance#150

Merged
rlippmann merged 9 commits into
mainfrom
codex/demo-changes
May 25, 2026
Merged

docs: refresh demo evaluation notes and provider guidance#150
rlippmann merged 9 commits into
mainfrom
codex/demo-changes

Conversation

@rlippmann

Copy link
Copy Markdown
Owner

What changed:

  • Added local Ollama context-size sweep results for the four-path demo comparison in docs/demos-results.md.
  • Added an exploratory Demo 05 long-transcript frontier note (separate from the historical full matrix).
  • Clarified direct Anthropic vs LiteLLM gateway OpenAI-compatible model naming in demos/README.md and docs/demos-results.md.
  • Updated stale demo wording that referred to three-path outcomes where four paths are now reported.

Why:

  • Keep demo docs aligned with current evaluation paths (baseline, reinjected-state, compiler, compiler+compact).
  • Prevent confusion around Anthropic model naming across direct endpoint vs gateway usage.
  • Preserve historical matrix integrity while documenting new exploratory evidence separately.

@rlippmann
rlippmann merged commit e2fb66b into main May 25, 2026
14 checks passed
@rlippmann
rlippmann deleted the codex/demo-changes branch May 25, 2026 03:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant