docs(deltagraph): add GA readiness checklist#342
Conversation
Captures the gates between current code-complete state (0.6.7-dev, Phase 4 merged) and 0.7.0 GA: live-warehouse correctness, perf baseline, soak, failure modes, concurrency, plus OAuth M2M / EXTERNAL_LINKS / observability. Also documents what local Apache Spark + Delta OSS can substitute for (SQL correctness, LDBC functional diff) and what it cannot (Statement Execution REST, auth, lifecycle, EXTERNAL_LINKS, Photon). Parking spot — pick up when a Databricks environment is available. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Pull request overview
This docs-only PR adds a DeltaGraph GA readiness checklist that captures validation gates, pre-GA feature work, local Spark substitution guidance, and explicit out-of-scope items for the path from 0.6.7-dev to 0.7.0 GA.
Changes:
- Adds GA gating criteria for correctness, performance, soak, failure modes, and concurrency.
- Defines pre-GA feature expectations around OAuth M2M, EXTERNAL_LINKS, and observability.
- Documents local Spark validation options and GA out-of-scope items.
| @@ -0,0 +1,175 @@ | |||
| # DeltaGraph — GA Readiness Checklist | |||
|
|
|||
| Engineering port is code-complete through Phase 4 (PRs #316–#341, all merged | |||
|
|
||
| ### 1. Correctness against a live warehouse | ||
|
|
||
| - LDBC SNB sweep (`bi-1..18`, `complex-1..14`, `short-1..7`) on Delta tables |
There was a problem hiding this comment.
Fixed in b965869 — gate now reads bi-1..15 and bi-17..18, with bi-16 explicitly excluded and a back-reference to the out-of-scope CALL section.
|
|
||
| ## GA exit criteria (the actual bar) | ||
|
|
||
| 1. LDBC SNB suite passes on Databricks with documented per-query times |
There was a problem hiding this comment.
Fixed in b965869 — exit criterion now reads '(excluding bi-16 — see CALL subquery note below)'.
| - **MERGE / write support** — DeltaGraph is read-only by design. QUICKSTART | ||
| documents this; no committed timeline for changing it. |
There was a problem hiding this comment.
Fixed in b965869 — MERGE moved out of the out-of-scope list into a should-land-before-GA bullet, matching what STATUS.md/CHANGELOG.md actually say ('pending before Databricks GA'). Also flagged the QUICKSTART wording mismatch ('not on the current roadmap') for reconciliation when MERGE lands.
| `benchmarks/social_network/schemas/social_benchmark.yaml` already defines | ||
| the smallest LDBC-style shape we use. A seed script that materializes | ||
| the same data as both ClickHouse tables and Delta tables would let us run | ||
| the diff in CI without external dependencies. |
There was a problem hiding this comment.
Fixed in b965869 — seeding section now points at benchmarks/ldbc_snb/schemas/ldbc_snb_complete.yaml (canonical LDBC superset with Person/Comment/Forum/Tag/Place/etc.) and explicitly notes that social_benchmark.yaml is dev-only sanity coverage, not LDBC.
- PR provenance: align with CHANGELOG (engineering PRs #316–#338, follow-ups #339/#340/#341 noted separately) instead of claiming the full range was all engineering work - Correctness gate + exit criterion: exclude bi-16 explicitly (blocked on CALL subqueries; was an impossible gate as written) - MERGE: move out of "explicitly out of scope" into a should-land-before-GA bullet, matching STATUS.md / CHANGELOG.md which both list MERGE as pending before Databricks GA. Flag the QUICKSTART wording mismatch for reconciliation when MERGE lands. - Local-dataset seeding: point at benchmarks/ldbc_snb/schemas/ for the actual LDBC label set; clarify that social_benchmark.yaml is dev-only sanity coverage, not LDBC Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
|
Pushed b965869 with all 5 fixes. Re-requesting Copilot review per HOUSE RULE (≥5 comments). |
Summary
docs/deltagraph/GA_READINESS.md— parking-spot doc for the work between code-complete (0.6.7-dev, Phase 4 merged) and 0.7.0 GACALLsubqueries)Docs-only, no code changes. Force-added past the
docs/gitignore (same pattern as the existingQUICKSTART.md).Test plan
STATUS.md/CHANGELOG.md/QUICKSTART.md🤖 Generated with Claude Code