Skip to content

Add compatibility-aware navigation scoring#76

Merged
DavidBakerEffendi merged 1 commit into
mainfrom
dave/compatible-navigation-scoring
Jul 24, 2026
Merged

Add compatibility-aware navigation scoring#76
DavidBakerEffendi merged 1 commit into
mainfrom
dave/compatible-navigation-scoring

Conversation

@DavidBakerEffendi

Copy link
Copy Markdown
Collaborator

Description

Add compatibility-aware destination scoring without changing the audited declaration and definition ground truth. This separates the destination users can reach from strict adherence to the case's canonical LSP operation, allowing implementations that expose the same destination through the other navigation API to receive recall credit while preserving protocol-precision reporting.

Key Changes:

  • Add explicit compatibleOperations benchmark metadata and execute compatible navigation routes separately in the Bifrost and LSP runners.
  • Report per-case requiredDestinationStatus and aggregate required-destination totals while retaining the existing strict canonical status and totals.
  • Annotate audited Go, JavaScript/TypeScript, and PHP cases and update the methodology, language pages, and result tables from fresh analyzer reports.
  • Validate compatible operations in the runtime model and checked JSON schema, with regression coverage for fallback isolation, unavailable routes, partial results, extra destinations, and report serialization.

Touch Points:

  • src/runners/
  • src/lib.rs
  • src/main.rs
  • schema/benchmark-case.schema.json
  • benchmarks/cases/
  • benchmarks/README.md
  • docs/src/content/docs/

Validation

  • cargo test --lib --bins
  • cargo run -- validate benchmarks/cases
  • npm --prefix docs run check
  • Fresh Bifrost, gopls, TypeScript language server, and Intelephense reports with zero runner errors

@DavidBakerEffendi
DavidBakerEffendi marked this pull request as ready for review July 24, 2026 16:53
@DavidBakerEffendi
DavidBakerEffendi merged commit 8dab8c9 into main Jul 24, 2026
3 checks passed
@DavidBakerEffendi
DavidBakerEffendi deleted the dave/compatible-navigation-scoring branch July 24, 2026 16:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant