Skip to content

fix: RedPajama token count uses findall not split#308

Open
Chessing234 wants to merge 1 commit into
allenai:mainfrom
Chessing234:fix/redpajama-token-count-findall
Open

fix: RedPajama token count uses findall not split#308
Chessing234 wants to merge 1 commit into
allenai:mainfrom
Chessing234:fix/redpajama-token-count-findall

fix: count RedPajama tokens with findall not split

5464531
Select commit
Loading
Failed to load commit list.
GitGuardian / GitGuardian Security Checks succeeded Jul 17, 2026 in 32s

No secrets detected ✅

1 commit was scanned without uncovering any secrets.

Details

Commit scanned: 1

  • Pull request #308: fix/redpajama-token-count-findall 👉 main

🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request.