Skip to content

speed up data loading#523

Merged
jw1912 merged 2 commits into
jw1912:mainfrom
JonathanHallstrom:loading_speedup
Jun 15, 2026
Merged

speed up data loading#523
jw1912 merged 2 commits into
jw1912:mainfrom
JonathanHallstrom:loading_speedup

Conversation

@JonathanHallstrom

Copy link
Copy Markdown
Contributor

speed up data loading with two optimizations:

  • pooling vectors for feature indices
  • only write one sentinel to the arrays of feature indices

~2x speedup to data loading for @jbienvenue, ~8x faster for me with pawn pawn inputs

@JonathanHallstrom JonathanHallstrom marked this pull request as draft June 13, 2026 13:15
@JonathanHallstrom JonathanHallstrom marked this pull request as ready for review June 13, 2026 22:28
@jw1912 jw1912 merged commit eb9f58b into jw1912:main Jun 15, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants