Skip to content

Releases: testmind-hq/caseforge

v0.11.0

08 May 01:11

Choose a tag to compare

Changelog

v0.10.2

03 May 13:01

Choose a tag to compare

Changelog

v0.10.1

27 Apr 14:56
e761aee

Choose a tag to compare

Bug Fixes

Documentation & CLI accuracy fix (#59)

  • Fixed allTechniqueNames shell-completion list — 3 stale entries did not match the actual Name() values used by --technique at runtime, causing --technique idempotent, --technique examples, and --technique chain to silently match nothing
    • idempotentidempotency
    • examplesexample_extraction
    • chainchain_crud
  • Updated README techniques table to reflect correct --technique flag values
  • Updated SKILL.md with correct technique names, added missing owasp_api_top10_spec, schema_violation, variable_irrelevance entries, and --save-history filename

Upgrade

brew upgrade caseforge
# or
go install github.com/testmind-hq/caseforge@latest

v0.10.0

27 Apr 14:15
b0fdbd2

Choose a tag to compare

What's New

Paper-inspired API Testing Techniques (#58)

  • --auth-bootstrap — Prepends an auth setup step to all secured-endpoint cases so every technique works out of the box against authenticated APIs
  • Run failure classification — Failed cases are automatically tagged server_error / missing_validation / auth_failure / security_regression
  • score --fill-gaps — Detects operations missing 2xx or 4xx coverage and auto-generates cases to close the gaps
  • --with-oracles — Two-step OC (Observation-Confirmation) LLM prompting mines response body constraints and injects them as assertions
  • business_rule_violation technique — Generates negative cases from LLM-annotated implicit business rules
  • chain_sequence technique — Detects non-CRUD producer-consumer chains via Jaccard field-name similarity
  • caseforge conformance — Mines oracle constraints and reports spec-vs-implementation mismatches against a live API

Portman/Microcks-inspired Techniques (#57)

  • Semantic annotation, field boundary, HAR import, conformance CI gate

CATS-inspired Fuzzing (#56)

  • Type coercion, unicode fuzzing, mass assignment, IDOR, explore extensions, pattern datagen

Schemathesis-inspired Features (#55)

  • Operation filtering, response schema validation, constraint_mutation, coverage scenarios, max-failures, rule dedup

EvoMaster-inspired Dynamic Testing (#54)

  • Dynamic API exploration enhancements

RESTler-inspired Dependency Graph & Chains (#53)

  • Dependency graph, chain technique, mutation, auth-chain, BFS chain command

Tcases-inspired Techniques (#52)

  • Six new test generation techniques

Upgrade

brew upgrade caseforge
# or
go install github.com/testmind-hq/caseforge@latest

v0.9.0

05 Apr 10:42
d53c275

Choose a tag to compare

New Features

Webhook Push Notifications

Configure on_generate / on_run_complete webhooks in .caseforge.yaml to receive real-time events as cases are generated. Supports HMAC-SHA256 request signing, configurable timeouts, and exponential backoff retry.

webhooks:
  - url: https://hooks.example.com/caseforge
    events: [on_generate, on_run_complete]
    secret: your-hmac-secret
    max_retries: 3

Test Case Scoring (caseforge score)

Multi-dimensional quality scoring of generated test cases: technique coverage, methodology distribution, priority balance, and OWASP coverage.

caseforge score --cases ./cases
caseforge score --cases ./cases --format json

TUI Progress & Checkpoint Resume

Live operation progress list during gen. Interrupted runs can be resumed from where they left off:

caseforge gen --spec openapi.yaml --resume

New Techniques

classification_tree (MBT Classification Tree) and orthogonal_array added to --technique.

CLI Commands

  • caseforge watch — watch a spec file and regenerate on change
  • caseforge stats — show test case statistics
  • caseforge ci init — generate CI workflow configs (GitHub Actions, GitLab CI, Jenkins, shell)

MCP Tools

lint_spec and ask_test_cases tools now exposed via the MCP server.

DEA Edge Case Hypotheses

Array constraint, required query parameter, and format violation probes added to dynamic API exploration.

Improvements

gotreesitter Migration (RBT)

The Risk-Based Testing engine no longer requires the external tree-sitter binary. Route extraction and callgraph analysis now use the embedded github.com/odvcencio/gotreesitter pure-Go library — no PATH dependency, tests run hermetically.

Score Bug Fix

caseforge score now groups operations by CaseSource.SpecPath (canonical METHOD /path) instead of Steps[0].Path. OWASP attack-injected step paths no longer inflate the operation count.

Documentation

  • All 23 commands documented with complete flag reference
  • Webhook configuration section with event table and HMAC signing note
  • Techniques table corrected (owasp_api_top10, example_extraction added)
  • Chinese README (README.zh-CN.md) fully synced
  • skills/caseforge/SKILL.md updated with common workflow examples

v0.8.0

04 Apr 13:55
63ace0c

Choose a tag to compare

Changelog

Read more

v0.7.0

23 Mar 11:40

Choose a tag to compare

Changelog