Skip to content

docs(gen): document --force, --annotation-batch, dedup, and hurl headers#72

Merged
yuchou87 merged 2 commits into
mainfrom
docs/update-readme-mcp-gen-flags
May 8, 2026
Merged

docs(gen): document --force, --annotation-batch, dedup, and hurl headers#72
yuchou87 merged 2 commits into
mainfrom
docs/update-readme-mcp-gen-flags

Conversation

@yuchou87

@yuchou87 yuchou87 commented May 8, 2026

Copy link
Copy Markdown
Contributor

Summary

Documents 4 features added in PRs #69 and #70 that were missing from README and the MCP tool definition.

README (caseforge gen section):

  • --force flag — regenerate despite unchanged spec hash
  • --annotation-batch N flag — batch LLM annotation calls
  • Smart regeneration behavior (spec-hash dedup, ✓ Spec unchanged message)
  • Batch annotation performance guidance (recommended: 8–20)
  • Rate-limit backoff (5 s → 15 s → 30 s → 60 s)
  • Hurl output headers (# case_id= and # case_name= fields)

MCP generate_test_cases tool (internal/mcp/tools.go):

  • Added force (boolean) to InputSchema
  • Added annotation_batch (integer) to InputSchema
  • Handler now calls engine.SetAnnotationBatch() when annotation_batch >= 1

Test Plan

  • go build ./... — passes
  • go test ./internal/mcp/... — passes

yuchou87 added 2 commits May 8, 2026 08:01
README:
- Add --force and --annotation-batch N flags to gen command reference
- Add Smart regeneration explanation (spec-hash dedup + --force)
- Add Batch annotation explanation (--annotation-batch performance tip)
- Add Rate-limit backoff note (5s→15s→30s→60s exponential backoff)
- Add Hurl output headers note (# case_id= and # case_name= fields)

MCP generate_test_cases tool:
- Add force (boolean) parameter to InputSchema
- Add annotation_batch (integer) parameter to InputSchema
- Wire annotation_batch into engine.SetAnnotationBatch() in the handler
- Remove force from generate_test_cases MCP schema — the MCP handler has no
  spec-hash dedup logic (it always regenerates), so the parameter was a silent
  no-op that misled callers
- Align SetAnnotationBatch docstring to "8–20" (was "5–20") to match README
- Standardize annotation_batch guard to >= 1 in cmd/gen.go (was > 0)
- Expand TestServerHasGenerateTestCasesTool to assert annotation_batch is
  present in the tool's InputSchema properties
@yuchou87 yuchou87 merged commit 52a9104 into main May 8, 2026
1 check passed
@yuchou87 yuchou87 deleted the docs/update-readme-mcp-gen-flags branch May 8, 2026 01:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant