Skip to content

fix(server): improve pipeline execution and row count accuracy#45

Merged
IamShobe merged 2 commits into
mainfrom
fix/engine-pipeline-improvements
Mar 20, 2026
Merged

fix(server): improve pipeline execution and row count accuracy#45
IamShobe merged 2 commits into
mainfrom
fix/engine-pipeline-improvements

Conversation

@IamShobe

Copy link
Copy Markdown
Owner

Summary

  • Use uuidv7 instead of crypto.randomUUID for sortable row IDs
  • Fix row count to use actual pipeline result length instead of potentially stale rawEventCount
  • Defer parquet writes so pipeline results are available immediately
  • Compute histogram from eventsResultPath instead of all chunk paths
  • Use proper drizzle eq() helper instead of raw SQL in deleteEntry
  • Consolidate @cruncher/server-shared imports into a single statement
  • Pass autoCompleteKeys through session restore path

Test plan

  • lint / format / tests / typecheck all pass (CI)
  • Query results show correct row counts
  • Session restore loads autocomplete keys correctly

- Use uuidv7 instead of crypto.randomUUID for row IDs (sortable)
- Fix row count to use actual pipeline result length instead of
  potentially stale rawEventCount
- Defer parquet writes so pipeline results are available immediately
- Compute histogram from eventsResultPath instead of all chunk paths
- Use proper drizzle eq() helper instead of raw SQL for deleteEntry
- Consolidate @cruncher/server-shared imports into a single statement
- Pass autoCompleteKeys through session restore path
@IamShobe
IamShobe merged commit 73b0a62 into main Mar 20, 2026
4 checks passed
@IamShobe
IamShobe deleted the fix/engine-pipeline-improvements branch March 20, 2026 12:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant