Evaluation#122

Merged

ashsong-nv merged 105 commits into

NVIDIA-AI-Blueprints:developfrom

katherineh123:wip-evaluation

Nov 3, 2025

Commits on Sep 3, 2025

wip evaluation: custom nat evaluation for simple accuracy, with custom input parsing for readability (see readme)
Katherine Huang
committed
putting back error handling info in readme that got deleted by accident
Katherine Huang
committed
removed wrong comment on accuracy numbers
Katherine Huang
committed
readme update for running multiple eval runs
Katherine Huang
committed
add to readme how to run multiple reps of eval
Katherine Huang
committed
test commit
katherineh123
committed
test commit
katherineh123
committed

Commits on Sep 5, 2025

Commits on Sep 6, 2025

Ground truth input file structure changed to list all containers; readme updated to reflect this. All eval functions are in a new eval directory. Custom evaluator registrations are moved to a new e…
katherineh123
committed

Commits on Sep 19, 2025

Commits on Sep 20, 2025

renamed response spread evaluator to response similarity, updated comments and readme with better explanations for the custom evaluators
katherineh123
committed

Commits on Oct 10, 2025

Commits on Oct 17, 2025

Commits on Oct 19, 2025

Commits on Oct 20, 2025

Commits on Oct 29, 2025

Commits on Oct 30, 2025

remove redundant output field
katherineh123
committed

Commits on Nov 3, 2025