Skip to content

Add CLI options to benchmark incremental resolution#903

Open
soutaro wants to merge 1 commit into
mainfrom
incremental-resolution-benchmark
Open

Add CLI options to benchmark incremental resolution#903
soutaro wants to merge 1 commit into
mainfrom
incremental-resolution-benchmark

Conversation

@soutaro

@soutaro soutaro commented Jul 3, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds --incremental_cycle / --incremental_files to measure incremental resolution cost (the re-resolve after an edit) separately from the initial full build. Dev/benchmark tooling only — no library behavior change.

After the initial build, each cycle re-indexes a rotating window of files (parse + the same invalidation the LSP runs on save) and re-runs resolve(), printing per-cycle and aggregate resolve() timings. Reindex/invalidation time is reported separately so it doesn't inflate the resolve numbers.

Usage

rubydex_cli <path> --incremental_cycle=10 --incremental_files=1 --stats
  • --incremental_cycle=N — run N incremental cycles after the initial build (default: off)
  • --incremental_files=M — files re-indexed per cycle (default: 1)

Notes

  • Files are chosen by index over the listing order, not a curated sample — sufficient for the current measurements, where the cost is largely delta-independent.

🤖 Generated with Claude Code

- --incremental_cycle=N runs N incremental resolve cycles after the initial build
- --incremental_files=N re-indexes N files per cycle (default 1)
- Reports per-cycle and aggregate resolve timings, plus reindex+invalidate cost

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@soutaro soutaro marked this pull request as ready for review July 3, 2026 08:48
@soutaro soutaro requested a review from a team as a code owner July 3, 2026 08:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants