Only return loose result in IFEval? #145

Open

opened

on Oct 28, 2025

According to the function "evaluate_accuracy" in eval.chat_benchmarks.IFEval.evaluation.py, the first strict result will be overwritten and never returned?

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests