Add report verification tool#7

Merged

kenjudy merged 40 commits into

mainfrom

add-report-verification-tool

Dec 14, 2025

Commits on Dec 9, 2025

Commits on Dec 11, 2025

feat: Add cache token extraction for cost analysis

kenjudy
and
claude
committed

Commits on Dec 12, 2025

Commits on Dec 14, 2025

Remove client-specific references and fix type issues

kenjudy
and
claude
committed
feat: Add Phase 3B cost analysis - initial implementation (TDD)

kenjudy
and
claude
committed
Add workflow cost aggregation (TDD GREEN)

kenjudy
and
claude
committed
Add scaling cost projections (TDD GREEN)

kenjudy
and
claude
committed
Add node aggregation and main analyze_costs() function (TDD GREEN)

kenjudy
and
claude
committed
Apply code quality fixes (Ruff + Black formatting)

kenjudy
and
claude
committed
Add Phase 3C failure detection and retry analysis (TDD GREEN)

kenjudy
and
claude
committed
Complete Phase 3C failure analysis with node stats and main function (TDD GREEN)

kenjudy
and
claude
committed
Extend verification tool with Phase 3B/3C support

kenjudy
and
claude
committed
Add Phase 3B/3C documentation and fix type errors
kenjudy
committed
Add Phase 3B/3C analysis script and fix None outputs handling
kenjudy
committed
Remove client-specific analysis script
kenjudy
committed
Add token usage export to LangSmith traces
kenjudy
committed
Update cost analysis to extract token fields from trace level
kenjudy
committed
Add token fields to Trace dataclass and JSON loading
kenjudy
committed
feat: Add cache token extraction for cost analysis

kenjudy
and
claude
committed
fix: Extract cache tokens from LangChain message structure

kenjudy
and
claude
committed
style: Apply black formatting

kenjudy
and
claude
committed
chore: Configure bandit to exclude test files

kenjudy
and
claude
committed
Remove client-specific references and fix type issues

kenjudy
and
claude
committed
Merge branch 'add-report-verification-tool' of github.com:stride-nyc/export-langsmith-data into add-report-verification-tool
kenjudy
committed