Why `bootstrap confidence interval` instead of direct use of `accuracy`?

[yqy2001]

Hello~

Why in the code, the optimization objective is bootstrap confidence interval, rather than directly using the accuracy?

Thank you.

[ShengranHu]

Hello, thanks for your questions. I anticipate that it may not be significantly different to use accuracy. We use median and confidence interval to provide more information to the meta agent (and match the final reported metrics).