Problem
codexbar serve --refresh-interval is documented as the response-cache TTL, but ServeArgs.refresh_interval is never used after argument parsing. Every /usage request fetches providers again and every /cost request rescans local usage, regardless of the configured value.
Where
rust/src/cli/serve.rsdocs/CLI.md
Expected behavior
- Cache successful responses for the configured TTL.
- Define and document the behavior of
--refresh-interval 0 (recommended: disable caching).
- Keep provider/account/request scopes separate in cache keys.
- Do not turn transient errors into long-lived cached failures.
- Avoid holding a cache lock while provider I/O runs.
Tests
Use a deterministic clock or short injectable TTL to verify cache hits, expiry, zero-TTL behavior, and independent /usage and /cost entries.
Problem
codexbar serve --refresh-intervalis documented as the response-cache TTL, butServeArgs.refresh_intervalis never used after argument parsing. Every/usagerequest fetches providers again and every/costrequest rescans local usage, regardless of the configured value.Where
rust/src/cli/serve.rsdocs/CLI.mdExpected behavior
--refresh-interval 0(recommended: disable caching).Tests
Use a deterministic clock or short injectable TTL to verify cache hits, expiry, zero-TTL behavior, and independent
/usageand/costentries.