Skip to content

fix: whitespace tokenizer uses findall for token count#309

Open
Chessing234 wants to merge 1 commit into
allenai:mainfrom
Chessing234:fix/whitespace-tokenizer-findall
Open

fix: whitespace tokenizer uses findall for token count#309
Chessing234 wants to merge 1 commit into
allenai:mainfrom
Chessing234:fix/whitespace-tokenizer-findall

Commits

Commits on Jul 17, 2026