Skip to content

[PROPOSAL] Delay OpenSearch 2.19.6 #118

Description

@Divyaasm

Description

The OpenSearch 2.19.6 patch release scheduled for today (2026-06-30) is proposed to be delayed by upto 1 week due to Maven repository throttling under concurrent CI load, blocking builds across multiple components and distributions.

Reason for Delay

Maven Repository Throttling Under Parallel CI Load

Failure chain:

  1. repo.maven returns HTTP 429 (Too Many Requests) due to rate limiting under parallel CI load
  2. ci.opensearch.org/ci/dbc/snapshots/maven is checked first in Gradle's repository resolution order and returns HTTP 503 (Service Unavailable) — the backing Lambda is unable to process multiple concurrent requests
  3. Gradle disables the repository entirely after the first 503 (Repository maven is disabled due to earlier error below), causing dependency resolution failures

Other Issues (Resolved)

  • k-NN build failure — Fixed via opensearch-project/k-NN#3403 (merged). Root cause was sed modifying a file that a git patch also targeted, causing index mismatch in CI.

Impact

  • Builds fail non-deterministically depending on concurrent CI load
  • Not a flaky test — entire dependency resolution phase fails
  • No security implications from the delay — this is a patch release

Proposed New Timeline

Milestone Original Date Proposed Date
Release 2026-06-30 2026-07-07

Resolution Path

  1. Switch dependency resolution to ci.opensearch.org/maven2 first.
  2. Validate builds succeed under concurrent load with updated repository ordering
  3. Re-run distribution builds across all platforms and validate

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions