Feature/integrate reth v2.3.0 by sduchesneau · Pull Request #13 · streamingfast/reth

sduchesneau · 2026-06-15T17:56:30Z

Merged tag 'v2.3.0'=

- `alloy-evm` patch rebased to `sf/v0.36.0` and wired up
- firehose crate ported to revm 40 / alloy-evm 0.36 (10 errors fixed across `inspector.rs`, `executor.rs`, `payload_validator.rs`)
- firehose unit (18), live-path regression (1), and golden tests (2) all pass — goldens updated for the revm `SYSTEM_CALL_GAS_LIMIT` change (30M → 31,566,720)

Co-authored-by: Centaur AI <ai@centaur.local>

Co-authored-by: Brian Picciano <933154+mediocregopher@users.noreply.github.com>

Co-authored-by: Brian Picciano <933154+mediocregopher@users.noreply.github.com> Co-authored-by: Amp <amp@ampcode.com>

Co-authored-by: ControlCplusControlV <randomlikeabledude@gmail.com>

Co-authored-by: Centaur AI <ai@centaur.local>

…4113)

Co-authored-by: Brian Picciano <933154+mediocregopher@users.noreply.github.com> Co-authored-by: Amp <amp@ampcode.com> Co-authored-by: Centaur AI <ai@centaur.local>

Co-authored-by: Centaur AI <ai@centaur.local>

) Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>

…er (paradigmxyz#24137) Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>

…z#24143) Co-authored-by: Centaur AI <ai@centaur.local>

Co-authored-by: Centaur AI <ai@centaur.local>

…aradigmxyz#24145) Co-authored-by: Centaur AI <ai@centaur.local>

…adigmxyz#23989) Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de> Co-authored-by: Arsenii Kulikov <klkvrr@gmail.com>

Co-authored-by: Centaur AI <ai@centaur.local>

Co-authored-by: Brian Picciano <933154+mediocregopher@users.noreply.github.com> Co-authored-by: Amp <amp@ampcode.com>

…#24144) Co-authored-by: Centaur AI <ai@centaur.local>

Co-authored-by: Centaur AI <ai@centaur.local>

…adigmxyz#24158) Co-authored-by: Centaur AI <ai@centaur.local>

)

…igmxyz#24977)

Co-authored-by: Derek <256792747+decofe@users.noreply.github.com> Co-authored-by: Arsenii Kulikov <klkvrr@gmail.com>

Co-authored-by: DaniPopes <57450786+DaniPopes@users.noreply.github.com>

Co-authored-by: Derek <256792747+decofe@users.noreply.github.com>

…24671)

…xyz#24848) Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>

…4995) Co-authored-by: Brian <brian@Host-007.homenet.telecomitalia.it> Co-authored-by: Brian <brian@Brians-MacBook-Pro.local> Co-authored-by: Derek <256792747+decofe@users.noreply.github.com> Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>

Co-authored-by: Brian <brian@Brians-MacBook-Pro.local> Co-authored-by: Brian <brian@Host-007.homenet.telecomitalia.it>

…adigmxyz#24776) Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>

…igmxyz#25037)

…#25048)

OpFirehoseEngineValidator (reth-optimism-firehose) is an external re-implementation of BasicEngineValidator that lives outside this crate and therefore cannot read pub(crate) fields. This one-line accessor exposes the existing state_trie_overlays field so external validators can call .with_state_trie_overlay_manager(...) on OverlayBuilder without rebuilding the manager from scratch on every request.

feat(engine): expose state_trie_overlays() accessor on TreeState

…er is initialized The Executor trait's provided execute() calls execute_one() unconditionally, which skips inspector attachment and emits no FIRE BLOCK output for any call site that doesn't know to call execute_and_trace_one() explicitly. Override execute() on FirehoseBlockExecutor to check is_tracer_initialized() and dispatch to execute_and_trace_one() when true. Any caller of execute() on a FirehoseBlockExecutor — including the pipeline batch executor path — now automatically emits Firehose traces without needing to be modified.

When the backfill pipeline finishes with zero blocks synced (ctrl.block_number() = None) — which is the normal outcome for OP Stack nodes that have no P2P peers because all blocks arrive exclusively via engine_newPayload — the engine returned early from on_backfill_sync_finished without calling try_connect_buffered_blocks. This left every block received via newPayload during the backfill window stuck in the block buffer indefinitely. The engine then triggered backfill again on the next FCU, downloaded zero blocks again, and repeated the loop forever. Only blocks that arrived during a brief idle window (between the failed backfill and the next FCU) could be executed — which is why only a handful of live blocks near the chain tip emitted FIRE BLOCK output while all historical blocks were silent. Fix: when backfill makes no progress, call try_connect_buffered_blocks with the current canonical head before returning. This flushes any buffered blocks whose parent state is already available (always true for the genesis → block 1 link on a fresh node) through validate_block_with_state, which emits Firehose FIRE BLOCK traces for each block. Blocks whose parent state is not yet available are simply re-buffered, so the change is safe for non-OP-Stack chains as well.

- `alloy-evm` patch rebased to `sf/v0.36.0` and wired up - firehose crate ported to revm 40 / alloy-evm 0.36 (10 errors fixed across `inspector.rs`, `executor.rs`, `payload_validator.rs`) - firehose unit (18), live-path regression (1), and golden tests (2) all pass — goldens updated for the revm `SYSTEM_CALL_GAS_LIMIT` change (30M → 31,566,720)

maoueh · 2026-06-15T18:10:38Z

  },
  "dependencies": {
    "mermaid": "^11",
-    "react": "19.2.4",


Doing those bump outside of our stuff leads to interesting questions, I feel personally we should ignore those and should not fix them in forks we maintain for tracing only reasons.

yes, it is tricky, let's review our 'dependabot ignore' procedure when this becomes a burden.

maoueh · 2026-06-15T18:21:49Z

Battlefield reth-dev and reth-devnet passes, approving

decofe and others added 30 commits May 11, 2026 12:19

ci(bench): add checkout step to save-state job (paradigmxyz#24125)

bb3aacc

Co-authored-by: Centaur AI <ai@centaur.local>

fix(ci): clean up scheduled bench cpu latency helper (paradigmxyz#24124)

c607b33

Co-authored-by: Brian Picciano <933154+mediocregopher@users.noreply.github.com>

ci: stop collector timers during reth benchmarks (paradigmxyz#24083)

11928d1

Co-authored-by: Brian Picciano <933154+mediocregopher@users.noreply.github.com> Co-authored-by: Amp <amp@ampcode.com>

refactor(engine): add block or payload type helpers (paradigmxyz#24119)

3ea2d06

fix(engine): validate received BAL on serial path (paradigmxyz#24122)

8b10a41

ci(bench): derive default warmup from block count (paradigmxyz#24131)

0552b86

Co-authored-by: Brian Picciano <933154+mediocregopher@users.noreply.github.com> Co-authored-by: Amp <amp@ampcode.com>

feat: support custom state root strategies (paradigmxyz#24130)

abaccb2

Co-authored-by: ControlCplusControlV <randomlikeabledude@gmail.com>

refactor: simplify reth-bb (paradigmxyz#23912)

5e2c169

Co-authored-by: Centaur AI <ai@centaur.local>

feat(bench): support txgen big-block benchmarks (paradigmxyz#24104)

db1b5e5

fix(net): validate downloaded block access list hashes (paradigmxyz#2…

5963237

…4113)

fix(bench): sync big-block weekly snapshots (paradigmxyz#24072)

4941d4e

Co-authored-by: Brian Picciano <933154+mediocregopher@users.noreply.github.com> Co-authored-by: Amp <amp@ampcode.com> Co-authored-by: Centaur AI <ai@centaur.local>

feat(otlp): make service.version configurable (paradigmxyz#24142)

b5886ca

Co-authored-by: Centaur AI <ai@centaur.local>

feat(engine): return BAL in payload bodies by hash v2 (paradigmxyz#24128

f127971

) Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>

test(engine): add coverage for BAL executor error paths and gas track…

8d21649

…er (paradigmxyz#24137) Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>

bench: set OTLP service.version to baseline/feature label (paradigmxy…

aa6e5ff

…z#24143) Co-authored-by: Centaur AI <ai@centaur.local>

ci(bench): bump BENCH_RUNNERS from 2 to 4 (paradigmxyz#24146)

e8374ae

Co-authored-by: Centaur AI <ai@centaur.local>

feat(otlp): add DefaultTraceValues for overridable service identity (p…

8248a24

…aradigmxyz#24145) Co-authored-by: Centaur AI <ai@centaur.local>

feat(debug-client): support block access list payload conversion (par…

157b1fc

…adigmxyz#23989) Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de> Co-authored-by: Arsenii Kulikov <klkvrr@gmail.com>

feat(engine): support BAL in create_reorg_head (paradigmxyz#24147)

b43e6b0

Co-authored-by: Centaur AI <ai@centaur.local>

ci(bench): use online CPUs for reth affinity (paradigmxyz#24148)

3033575

Co-authored-by: Brian Picciano <933154+mediocregopher@users.noreply.github.com> Co-authored-by: Amp <amp@ampcode.com>

bench: extract txgen payloads once and reuse across runs (paradigmxyz…

3eb7e62

…#24144) Co-authored-by: Centaur AI <ai@centaur.local>

feat(rpc): support BAL with block RLP payloads (paradigmxyz#24153)

e8a5a3c

ci(bench): update Grafana datasource (paradigmxyz#24150)

1b5696e

Co-authored-by: Centaur AI <ai@centaur.local>

docs(engine): update getPayloadV6 handler docs (paradigmxyz#24156)

0b9b729

bench: show per-phase status in PR comment during benchmark runs (par…

15c0773

…adigmxyz#24158) Co-authored-by: Centaur AI <ai@centaur.local>

fix(net): model unavailable BALs explicitly (paradigmxyz#24157)

abcbab8

refactor: spawn full block validation (paradigmxyz#24160)

2c1cb29

refactor(tasks): use parking_lot mutex in lazy handle (paradigmxyz#24161

f10844d

)

docs: update security contact (paradigmxyz#24165)

c71343b

refactor(rpc): simplify blob bundle validation (paradigmxyz#24169)

a638890

lean-apple and others added 23 commits June 8, 2026 11:53

refactor(era-utils): generalize import over EraBlockReader (parad…

5fab66d

…igmxyz#24977)

test: add roundtrip tests for er(a)e files (paradigmxyz#24905)

6b1ad1f

ci: summarize hive failure logs (paradigmxyz#25001)

101385a

feat(rpc): add eth simulate state root flag (paradigmxyz#24564)

581ee5c

Co-authored-by: Derek <256792747+decofe@users.noreply.github.com> Co-authored-by: Arsenii Kulikov <klkvrr@gmail.com>

perf(parbal): BAL prewarming pool (paradigmxyz#25003)

b969584

Co-authored-by: DaniPopes <57450786+DaniPopes@users.noreply.github.com>

fix: avoid clearing rocksdb unnecesarily (paradigmxyz#24903)

c8d9e04

Co-authored-by: Derek <256792747+decofe@users.noreply.github.com>

feat(payload): cache parent block info for payload jobs (paradigmxyz#…

c6379a9

…24671)

feat(txpool): add ValidatingPool trait for validator access (paradigm…

44b904a

…xyz#24848) Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>

fix: remove precompile cache initial capacity (paradigmxyz#25013)

72fafb5

fix(cli): target reth download --force cleanup (paradigmxyz#25015)

949834a

fix(chain-state): avoid state overlay cache deadlock (paradigmxyz#24875)

84d8e47

Co-authored-by: Brian <brian@Brians-MacBook-Pro.local> Co-authored-by: Brian <brian@Host-007.homenet.telecomitalia.it>

feat(net): add outbound peer rotation to prevent slot saturation (par…

3a22037

…adigmxyz#24776) Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>

perf(transaction-pool): specialize same-origin batch insertion (parad…

e5fd762

…igmxyz#25037)

fix(rlpx): bound mux outbound buffer fairly (paradigmxyz#25031)

01cbe9b

chore(deps): bump revm-inspectors to 0.40.1 (paradigmxyz#25047)

8919e67

feat(revm): add CachedReads account capacity constructor (paradigmxyz…

9f2837e

…#25048)

Merge pull request #12 from streamingfast/feature/open-state-overlays

bbb2cd1

feat(engine): expose state_trie_overlays() accessor on TreeState

chore(release): bump version to 2.3.0 (paradigmxyz#25071)

9384bc5

sduchesneau requested a review from maoueh June 15, 2026 17:56

bump docs dependencies to address detected vulns in github PR

ad10183

maoueh reviewed Jun 15, 2026

View reviewed changes

maoueh approved these changes Jun 15, 2026

View reviewed changes

sduchesneau merged commit a81382c into firehose/2.x Jun 15, 2026
2 checks passed

sduchesneau deleted the feature/integrate-reth-v2.3.0 branch June 15, 2026 18:29

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Feature/integrate reth v2.3.0#13

Feature/integrate reth v2.3.0#13
sduchesneau merged 338 commits into
firehose/2.xfrom
feature/integrate-reth-v2.3.0

sduchesneau commented Jun 15, 2026

Uh oh!

maoueh Jun 15, 2026

Uh oh!

sduchesneau Jun 15, 2026

Uh oh!

maoueh commented Jun 15, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Conversation

sduchesneau commented Jun 15, 2026

Uh oh!

maoueh Jun 15, 2026

Choose a reason for hiding this comment

Uh oh!

sduchesneau Jun 15, 2026

Choose a reason for hiding this comment

Uh oh!

maoueh commented Jun 15, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants