Skip to content

[flaky test] TestBFTDeliverer_CensorshipMonitorEvents/repeated_censorship_events,_with_exponential_backoff #128

Description

@liran-funaro
=== FAIL: common/deliverclient/blocksprovider TestBFTDeliverer_CensorshipMonitorEvents/repeated_censorship_events,_with_exponential_backoff (20.15s)
2026-06-30 13:14:14.163 UTC 070f INFO [common.tools.configtxgen] completeInitialization -> Orderer.BatchSize.PreferredMaxBytes unset, setting to 2097152
2026-06-30 13:14:14.163 UTC 0710 INFO [common.tools.configtxgen] completeInitialization -> orderer type: BFT
2026-06-30 13:14:14.163 UTC 0711 INFO [common.tools.configtxgen] Load -> Loaded configuration: /home/runner/work/fabric-x-common/fabric-x-common/sampleconfig/configtx.yaml
2026-06-30 13:14:14.183 UTC 0712 INFO [BFTDeliverer.test] initDeliverBlocks -> Starting to DeliverBlocks on channel `channel-id`, block height=7
2026-06-30 13:14:14.184 UTC 0713 INFO [BFTDeliverer.test] refreshSources -> Refreshed endpoints: [Address: orderer-address-1, CertHash: <nil> Address: orderer-address-2, CertHash: <nil> Address: orderer-address-3, CertHash: <nil> Address: orderer-address-4, CertHash: <nil>]
    bft_deliverer_test.go:1093: monitor error channel returns censorship error num: 1
2026-06-30 13:14:14.188 UTC 0714 INFO [BlockReceiver] Start -> BlockReceiver starting orderer-address=orderer-address-1
2026-06-30 13:14:14.188 UTC 0715 WARN [BFTDeliverer.test] handleFetchAndCensorshipEvents -> Censorship suspicion: censorship 1; going to retry fetching blocks from another orderer
2026-06-30 13:14:14.188 UTC 0716 INFO [BlockReceiver] Stop -> BlockReceiver stopped orderer-address=orderer-address-1
2026-06-30 13:14:14.189 UTC 0717 WARN [BFTDeliverer.test] retryBackoff -> Failed to fetch blocks, count=1, round=0, going to retry in 100ms
2026-06-30 13:14:14.190 UTC 0718 INFO [BlockReceiver] Start -> BlockReceiver starting orderer-address=orderer-address-2
2026-06-30 13:14:14.189 UTC 0719 INFO [BlockReceiver] ProcessIncoming -> BlockReceiver got a signal to stop orderer-address=orderer-address-1
2026-06-30 13:14:14.191 UTC 071a WARN [BlockReceiver] func1 -> Encountered an error reading from deliver stream: fake-recv-step-error orderer-address=orderer-address-1
    bft_deliverer_test.go:1093: monitor error channel returns censorship error num: 2
2026-06-30 13:14:14.198 UTC 071b WARN [BFTDeliverer.test] handleFetchAndCensorshipEvents -> Censorship suspicion: censorship 2; going to retry fetching blocks from another orderer
2026-06-30 13:14:14.199 UTC 071c INFO [BlockReceiver] Stop -> BlockReceiver stopped orderer-address=orderer-address-2
2026-06-30 13:14:14.199 UTC 071d WARN [BFTDeliverer.test] retryBackoff -> Failed to fetch blocks, count=2, round=0, going to retry in 100ms
2026-06-30 13:14:14.199 UTC 071e INFO [BlockReceiver] ProcessIncoming -> BlockReceiver got a signal to stop orderer-address=orderer-address-2
2026-06-30 13:14:14.199 UTC 071f WARN [BlockReceiver] func1 -> Encountered an error reading from deliver stream: fake-recv-step-error orderer-address=orderer-address-2
2026-06-30 13:14:14.200 UTC 0720 INFO [BlockReceiver] Start -> BlockReceiver starting orderer-address=orderer-address-3
    bft_deliverer_test.go:1093: monitor error channel returns censorship error num: 3
2026-06-30 13:14:14.209 UTC 0721 WARN [BFTDeliverer.test] handleFetchAndCensorshipEvents -> Censorship suspicion: censorship 3; going to retry fetching blocks from another orderer
2026-06-30 13:14:14.209 UTC 0722 INFO [BlockReceiver] Stop -> BlockReceiver stopped orderer-address=orderer-address-3
2026-06-30 13:14:14.209 UTC 0723 WARN [BFTDeliverer.test] retryBackoff -> Failed to fetch blocks, count=3, round=0, going to retry in 100ms
2026-06-30 13:14:14.209 UTC 0724 INFO [BlockReceiver] ProcessIncoming -> BlockReceiver got a signal to stop orderer-address=orderer-address-3
2026-06-30 13:14:14.210 UTC 0725 WARN [BlockReceiver] func1 -> Encountered an error reading from deliver stream: fake-recv-step-error orderer-address=orderer-address-3
2026-06-30 13:14:14.211 UTC 0726 INFO [BlockReceiver] Start -> BlockReceiver starting orderer-address=orderer-address-4
    bft_deliverer_test.go:1093: monitor error channel returns censorship error num: 4
2026-06-30 13:14:14.215 UTC 0727 WARN [BFTDeliverer.test] handleFetchAndCensorshipEvents -> Censorship suspicion: censorship 4; going to retry fetching blocks from another orderer
2026-06-30 13:14:14.215 UTC 0728 INFO [BlockReceiver] Stop -> BlockReceiver stopped orderer-address=orderer-address-4
2026-06-30 13:14:14.215 UTC 0729 WARN [BFTDeliverer.test] retryBackoff -> Failed to fetch blocks, count=4, round=1, going to retry in 200ms
2026-06-30 13:14:14.215 UTC 072a INFO [BlockReceiver] ProcessIncoming -> BlockReceiver got a signal to stop orderer-address=orderer-address-4
2026-06-30 13:14:14.215 UTC 072b WARN [BlockReceiver] func1 -> Encountered an error reading from deliver stream: fake-recv-step-error orderer-address=orderer-address-4
2026-06-30 13:14:14.216 UTC 072c INFO [BlockReceiver] Start -> BlockReceiver starting orderer-address=orderer-address-1
    bft_deliverer_test.go:1093: monitor error channel returns censorship error num: 5
2026-06-30 13:14:14.226 UTC 072d WARN [BFTDeliverer.test] handleFetchAndCensorshipEvents -> Censorship suspicion: censorship 5; going to retry fetching blocks from another orderer
2026-06-30 13:14:14.226 UTC 072e INFO [BlockReceiver] Stop -> BlockReceiver stopped orderer-address=orderer-address-1
2026-06-30 13:14:14.226 UTC 072f WARN [BFTDeliverer.test] retryBackoff -> Failed to fetch blocks, count=5, round=1, going to retry in 200ms
2026-06-30 13:14:14.226 UTC 0730 INFO [BlockReceiver] ProcessIncoming -> BlockReceiver got a signal to stop orderer-address=orderer-address-1
2026-06-30 13:14:14.226 UTC 0731 WARN [BlockReceiver] func1 -> Encountered an error reading from deliver stream: fake-recv-step-error orderer-address=orderer-address-1
2026-06-30 13:14:14.227 UTC 0732 INFO [BlockReceiver] Start -> BlockReceiver starting orderer-address=orderer-address-2
    bft_deliverer_test.go:1093: monitor error channel returns censorship error num: 6
2026-06-30 13:14:14.236 UTC 0733 WARN [BFTDeliverer.test] handleFetchAndCensorshipEvents -> Censorship suspicion: censorship 6; going to retry fetching blocks from another orderer
2026-06-30 13:14:14.236 UTC 0734 INFO [BlockReceiver] Stop -> BlockReceiver stopped orderer-address=orderer-address-2
2026-06-30 13:14:14.236 UTC 0735 WARN [BFTDeliverer.test] retryBackoff -> Failed to fetch blocks, count=6, round=1, going to retry in 200ms
2026-06-30 13:14:14.236 UTC 0736 INFO [BlockReceiver] ProcessIncoming -> BlockReceiver got a signal to stop orderer-address=orderer-address-2
2026-06-30 13:14:14.237 UTC 0737 WARN [BlockReceiver] func1 -> Encountered an error reading from deliver stream: fake-recv-step-error orderer-address=orderer-address-2
2026-06-30 13:14:14.238 UTC 0738 INFO [BlockReceiver] Start -> BlockReceiver starting orderer-address=orderer-address-3
    bft_deliverer_test.go:1093: monitor error channel returns censorship error num: 7
2026-06-30 13:14:14.247 UTC 0739 WARN [BFTDeliverer.test] handleFetchAndCensorshipEvents -> Censorship suspicion: censorship 7; going to retry fetching blocks from another orderer
2026-06-30 13:14:14.247 UTC 073a INFO [BlockReceiver] Stop -> BlockReceiver stopped orderer-address=orderer-address-3
2026-06-30 13:14:14.247 UTC 073b WARN [BFTDeliverer.test] retryBackoff -> Failed to fetch blocks, count=7, round=1, going to retry in 200ms
2026-06-30 13:14:14.248 UTC 073c INFO [BlockReceiver] ProcessIncoming -> BlockReceiver got a signal to stop orderer-address=orderer-address-3
2026-06-30 13:14:14.248 UTC 073d WARN [BlockReceiver] func1 -> Encountered an error reading from deliver stream: fake-recv-step-error orderer-address=orderer-address-3
    bft_deliverer_test.go:1093: monitor error channel returns censorship error num: 8
2026-06-30 13:14:14.249 UTC 073e WARN [BFTDeliverer.test] handleFetchAndCensorshipEvents -> Censorship suspicion: censorship 8; going to retry fetching blocks from another orderer
2026-06-30 13:14:14.249 UTC 073f INFO [BlockReceiver] Stop -> BlockReceiver already stopped orderer-address=orderer-address-3
2026-06-30 13:14:14.250 UTC 0740 WARN [BFTDeliverer.test] retryBackoff -> Failed to fetch blocks, count=8, round=2, going to retry in 400ms
2026-06-30 13:14:14.251 UTC 0741 INFO [BlockReceiver] Start -> BlockReceiver starting orderer-address=orderer-address-1
2026-06-30 13:14:14.251 UTC 0742 INFO [BlockReceiver] Start -> BlockReceiver starting orderer-address=orderer-address-4
    bft_deliverer_test.go:1093: monitor error channel returns censorship error num: 9
2026-06-30 13:14:14.260 UTC 0743 WARN [BFTDeliverer.test] handleFetchAndCensorshipEvents -> Censorship suspicion: censorship 9; going to retry fetching blocks from another orderer
2026-06-30 13:14:14.260 UTC 0744 INFO [BlockReceiver] Stop -> BlockReceiver stopped orderer-address=orderer-address-4
2026-06-30 13:14:14.260 UTC 0745 INFO [BlockReceiver] ProcessIncoming -> BlockReceiver got a signal to stop orderer-address=orderer-address-4
2026-06-30 13:14:14.261 UTC 0746 WARN [BFTDeliverer.test] retryBackoff -> Failed to fetch blocks, count=9, round=2, going to retry in 400ms
2026-06-30 13:14:14.261 UTC 0747 WARN [BlockReceiver] func1 -> Encountered an error reading from deliver stream: fake-recv-step-error orderer-address=orderer-address-1
2026-06-30 13:14:14.261 UTC 0748 WARN [BlockReceiver] ProcessIncoming -> Orderer hung up without sending status orderer-address=orderer-address-1
2026-06-30 13:14:14.261 UTC 0749 WARN [BlockReceiver] func1 -> Encountered an error reading from deliver stream: fake-recv-step-error orderer-address=orderer-address-4
2026-06-30 13:14:14.261 UTC 074a WARN [BFTDeliverer.test] FetchBlocks -> Failure while processing incoming blocks: orderer `orderer-address-1` hung up without sending status
2026-06-30 13:14:14.261 UTC 074b WARN [BFTDeliverer.test] retryBackoff -> Failed to fetch blocks, count=10, round=2, going to retry in 400ms
2026-06-30 13:14:14.262 UTC 074c INFO [BlockReceiver] Start -> BlockReceiver starting orderer-address=orderer-address-2
2026-06-30 13:14:14.263 UTC 074d INFO [BlockReceiver] Start -> BlockReceiver starting orderer-address=orderer-address-3
    bft_deliverer_test.go:1107: 
        Timed out after 20.000s.
        Expected
            <int>: 11
        to equal
            <int>: 10
    --- FAIL: TestBFTDeliverer_CensorshipMonitorEvents/repeated_censorship_events,_with_exponential_backoff (20.15s)

=== FAIL: common/deliverclient/blocksprovider TestBFTDeliverer_CensorshipMonitorEvents (20.59s)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    Fields

    No fields configured for Task.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions