Skip to content

[Feature Request] Unexpected tool calls should be surfaced #283

Description

@Kulikowski

Due to model hallucination we can see attempts to call tools that are non-existent.

We should properly mark it in the report to make sure that it's visible.

Currently when we have more tool calls than expected, the matcher will match it as "null" expected pattern which can be confusing.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions