elasticsearch: add index mode and codec dashboard visualizations

[JohannesMahne]

Summary

• Wire elasticsearch.index.mode and elasticsearch.index.codec through the index_pivot transform (fleet_transform_version 0.4.0); values are read from Metricbeat index metricset source indices (metrics-elasticsearch.stack_monitoring.index*, etc.) and require Metricbeat 8.19+ (beats#49237, backported to 8.19); normalize missing values to standard / default in ingest pipelines when absent
• Add mode/codec controls and panels to the Consumption dashboard
• Expand Index & Shard View with mode/codec distribution, storage, and time-series panels
• Fix Index & Shard View for Kibana 8.10.1 minimum (typeMigrationVersion 8.9.0, controlGroupInput instead of Kibana 9.4 pinned_panels)
• Bump package to 1.22.0 and document the Metricbeat dependency in package docs and changelog

Dependencies

Index mode and codec rely on Metricbeat collecting elasticsearch.index.mode and elasticsearch.index.codec in the Elasticsearch index metricset. The integration writes those metrics to source indices such as metrics-elasticsearch.stack_monitoring.index*, which the index_pivot transform reads. This collection path was added in beats#49237 and is available from Metricbeat 8.19 onward (backported to the 8.19 branch). Without it, mode and codec are absent from source documents and ingest pipelines normalize missing values to standard and default.

Test plan

• elastic-package build and elastic-package install on Kibana 8.10.1 (package minimum)
• Start logs-elasticsearch.index_pivot-default-0.4.0 transform; verify monitoring-indices includes mode/codec
• Verify Consumption and Index & Shard View dashboards render
• Run ingest pipeline tests under packages/elasticsearch/elasticsearch/ingest_pipeline/_dev/test/pipeline/

Made with Cursor

[github-actions]

✅ Elastic Docs Style Checker (Vale)

No issues found on modified lines!

---

The Vale linter checks documentation changes against the Elastic Docs style guide. To use Vale locally or report issues, refer to Elastic style guide for Vale.

[elastic-vault-github-plugin-prod]

Changelog link mismatch — expected https://github.com/elastic/integrations/pull/19520 in the following file(s):

• packages/elasticsearch/changelog.yml

Tip

If expected, add the changelog-link-check:skip label to skip this check. Or, if an issue link was intended, use .../issues/<n> instead.

View Buildkite build
@JohannesMahne

[elasticmachine]

💔 Build Failed

• Buildkite Build
• Commit: 3fecced

Failed CI Steps

• 📜 Check changelog PR links

History

[elastic-vault-github-plugin-prod]

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

[JohannesMahne]

Stacked delivery PR for the dashboard fix commit (8207d28f39): #19522 — merges into feature/es-index-mode-codec-compat once CI is green.