- evaluate the effect of chunk size (1024 vs 512 vs 2048) * on both latency & eval metrics - get a better sense of latency vs metric trade-offs * e.g. the trade-offs of changing answering effort from "normal" to "thinking"
evaluate the effect of chunk size (1024 vs 512 vs 2048)
get a better sense of latency vs metric trade-offs