Skip to content

[Feature Request] Add progress bar to evals CLI #282

Description

@maudnals

As discussed with @Kulikowski:
A basic version would be to do doneSteps / totalStepCount

Each test case can have 1 step (tool call) - n steps (= tool calls)

Also, fix the in-CLI step preview at the moment which displays a wrong step count (remember step count is unknown ahead of time!)

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions