Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,10 @@ release.

### OTEPs

- Proposal for full federation of Semantic Convention repositories and how
they will be managed and released.
([#4906](https://github.com/open-telemetry/opentelemetry-specification/pull/4906))

## v1.57.0 (2025-05-19)

### Metrics
Expand Down
238 changes: 238 additions & 0 deletions oteps/4906-federated-semantic-conventions-lifecycle.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,238 @@
# Federated Semantic Convention Lifecycle

This OTEP defines the lifecycle, independent versioning, and consolidation path for federated semantic conventions in OpenTelemetry. It expands on the technical foundation provided by OTEP 4815 (Federated SemConv and Schema v2) and the stability goals of OTEP 4813 (Stable by Default).

## Motivation

As OpenTelemetry's semantic conventions expand, a monolithic registry and versioning scheme create friction:

1. **Slow Evolution**: Highly specialized or domain-specific conventions (e.g., JVM metrics, cloud-provider-specific resources) are often gated by the slower stabilization process of the core registry.
2. **Coupled Breaking Changes**: A major version bump in one sub-domain (e.g., a total overhaul of database conventions) should not force the entire OpenTelemetry ecosystem to adopt a major version bump.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How does this propagate to natively instrumented libraries and what incentive do they have to move to newer conventions? There always is a transform layer running?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As an alternative to a transform layer running always, I wish to see more-flexible ways to reconfigure static transforms over original instrumentation. In other words, to modify the telemetry at the start instead of in a pipeline (ideally using code generated from the semantic conventions).

3. **Instrumentation Stability**: Instrumentation libraries need a clear way to declare stability for their OTLP output by pinning to specific versions of the conventions they implement, regardless of whether those conventions are "core" or "federated".

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

are conventions in a particular version all uniformly considered "stable"?


We need a federated model where conventions can move at different speeds while still being part of a "cohesive whole" with obvious version conformance for end users.

## Goals

1. **Independent Lifecycle**: Enable domain-specific semantic convention registries to have their own SemVer lifecycle.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what are the rules of semver here. Like dropping an attribute is "breaking" - what if it was optional?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removing an opt-in attribute would still be breaking for those users that have opted-in.

2. **Instrumentation Pinning**: Allow instrumentation libraries to declare stability by pinning to specific federated registry versions.
3. **Platform Releases**: Provide a mechanism (Platform Releases) to bundle specific versions of federated registries into a "tested-together" cohesive set.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the acceptance criteria for "tested together", what if an instrumentation fails, is it removed from release?

4. **Promotion Path**: Define a clear path for federated conventions to be consolidated into the core OpenTelemetry registry.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What if end-users want to opt out of expensive / PII risking conventions. Do these still land in core? What is the final say for something deserving to be in core. I'm unfamiliar here.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We allow expensive / PII in core, with opt_in today and there's guidance around it. I think this is an orthogonal concern to this proposal, but an important issue that needs a solution across various components of OpenTelemetry.

For this proposal, we continue with the current behavior we have.


## Details

### 1. Federated Registry Lifecycle

Each federated registry (as defined in OTEP 4815) manages its own versioning independently.

**The JVM Metrics Example**:
The JVM Metrics registry (e.g., `opentelemetry.io/schemas/jvm`) identifies a need to overhaul its metric names to align with a new runtime standard.

#### Registry Structure

A federated registry like `jvm-metrics` would contain a manifest, the convention definitions, and a policy enforcement GitHub Action.

For example:

**`manifest.yaml`**:

```yaml
schema_url: https://opentelemetry.io/schemas/jvm/2.0.0
description: Semantic Conventions for JVM Metrics
stability: stable

dependencies:
- schema_url: https://opentelemetry.io/schemas/semconv/1.49.0
```

**`jvm.yaml`**:

```yaml
file_format: definition/2
metrics:
- name: jvm.memory.used
...
```

#### Registry Requirements

- The registry MUST declare a dependency on core semantic conventions.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so that there is no chance of having conflicts / vendoring in in incompatible manner / etc?

I like it!

Comment thread
dashpole marked this conversation as resolved.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this needs to define what dependency means for schema URLs and generated language artifacts. If a federated registry depends on core semantic conventions, does its schema URL identify only the local registry, or a resolved closure that also covers the dependency attributes it uses?

For Go this is not just a manifest detail. Generated semconv packages are versioned import paths, so a future genai/v0.x.0 package and semconv/v1.42.0 package would expose separate constants and helpers. The OTEP should say whether instrumentation using a federated registry should use the federated SchemaURL, the core SchemaURL, a platform-release schema URL, or something else when it emits attributes from both.

- A stable federated registry MUST NOT depend on unstable or experimental core conventions.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what if the federated conventions need the unstable conventions for it to make sense - example being session / threading of agents.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then the federated convention would be marked "unstable" as well. Basically you can't declare a "child" convention stable unless the "parent" is also stable.

This doesn't preclude usage, just stability declaration.

- The registry MUST use a dependabot or renovate bot to keep dependencies up-to-date.
- The registry MUST enforce semantic convention [policies](https://github.com/open-telemetry/opentelemetry-weaver-packages) via GitHub workflow, e.g.

`.github/workflows/semconv-policy.yaml`:

```yaml
name: Semantic Convention Policy Check
...
jobs:
weaver-check:
runs-on: ubuntu-latest
steps:
- name: check out code
uses: actions/checkout@... # v...
- name: set up weaver
uses: open-telemetry/weaver/.github/actions/setup-weaver@... # v...
- name: verify template packages
run: weaver registry check \
-r {my_registry_dir} \
-p https://github.com/open-telemetry/opentelemetry-weaver-packages.git[policies/check/naming_conventions] \

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: it's the same on as the last one? (policies/check/naming)

-p https://github.com/open-telemetry/opentelemetry-weaver-packages.git[policies/check/stability] \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can / should the checks use versioned opentelemetry-weaver-packages?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Absolutely! We need to cut our first release of that repo

-p https://github.com/open-telemetry/opentelemetry-weaver-packages.git[policies/check/naming]
```

#### Independent Versioning

- It releases `v2.0.0` of the `jvm` federated registry.
- This release is **completely independent** of the core `semconv` registry (which might still be at `v1.45.0`) and other registries like `http` or `messaging`.
- Users who want the new JVM metrics can opt-in by utilizing declarative configuration mechanisms (e.g., `version: 2`, `dual_emit: true`).
This should implicitly update the `schema_url` of telemetry, allowing users to see which version is which and address versioning issues.
- Existing users of `v1.x.x` are unaffected and continue to see the old OTLP output.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

which users are we talking about. The end-user?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes

- **Policy Enforcement**: The federated registry leverages shared GitHub Actions and workflows to enforce official OpenTelemetry policies (e.g., naming conventions, stability rules) even while iterating independently.

### 2. Instrumentation Stability and OTLP Output

Instrumentation libraries "own" the stability of the OTLP they produce. To maintain this stability:

- **Pinning**: An instrumentation library MUST specify the `schema_url` of the federated registry version it targets in its `Scope` metadata, via `get {Meter|Tracer|Logger}` operations.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is underspecified for instrumentation that emits mixed semantic-convention namespaces from one scope. Existing Go contrib instrumentation already does this: HTTP emits http.*, url.*, server.*, network.*, and error.type; AWS SDK v2 emits rpc.*, aws.*, messaging.*, db.*, and server.*; MongoDB emits db.* and network.*; gRPC metrics combine RPC conventions with server.* attributes.

Since a Tracer/Meter/Logger scope has one schema URL, the OTEP needs to say which schema URL such instrumentation should set. If the answer is the federated registry's schema URL, then that URL needs to be defined as a resolved schema that also covers dependency attributes. If not, language maintainers need the alternative rule.

- **Breaking Changes**: If an instrumentation library adopts a new major version of a federated registry that results in breaking changes to its OTLP output, the library ITSELF must perform a major version bump. For example, if `opentelemetry-java-instrumentation` moves from `jvm/v1` to `jvm/v2`, it must release a new major version of its instrumentation package.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is not so simple. Instrumentation is dependent on now two versions, the library it instruments AND the semcov that it tracks. What if the instrumentation needs to move a major version for library changes, then subsequently needs to backfill support for an older version. Now there is no tenable way to track both semcov breaking changes with library breaking changes.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I intend this to mean the opposite, or at least I don't see them as coupled.

  • If you make a breaking change in semconv, you need a major version bump on your library.
  • You may need major version bump on your library for other reasons, you do NOT need to bump semconv major version for this.

The key here is folks understand they need to do the first, and that the output signals of an instrumentation library are part of its stability.

Regarding tracking both semconv breaking + library breaking changes - I wanted to keep this simpler where you mostly just pay attention to library major version bumps, and then schema_url and backends can help you handle incompatibilities / conversions downstream.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

then subsequently needs to backfill support for an older version

@mikeldking Are you asking about backporting a semconv breaking change to an older instrumentation version?

- **Stable by Default**: Following OTEP 4813, instrumentation can be marked as stable once its code and OTLP output are production-ready, this means marking any federated registry as stable, in tandem with the library.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we want to allow stable (federated) registry to depend on unstable parts of otel conventions?

I think we can go either way.
If we don't allow it: they can take dependency on stable parts only and vendor in unstable parts if necessary.
If we allow it, they should be able to communicate breaking changes in unstable core via semver.

Either way, we need some forcing factors for them to

  • update to newer underlying core - it will be hard regardless
  • bring common concepts to core conventions

I'd rather not allow it at least initially and encourage to vendor in experimental stuff.

@mikeldking mikeldking Mar 3, 2026

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What if the library is unstable?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We would allow semconv to be marked as stable prior to libraries being fully stable. This is more to prevent the opposite in otel - libraries which are production-ready NOT declaring stability, because of a looming threat of semconv changes.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This feels like the opposite of how I understood the proposal in #4813. That seemed to say that instrumentation libraries should declare themselves stable without regard to the stability of the semantic conventions they use. This seems to be saying that semantic conventions used by stable instrumentation libraries must be, by definition, stable. What of an instrumentation library that is "stable" but for dependence on semantic conventions that are "experimental"?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can see my back and forth about #4813 - That was the wrong impression and the wording (should be corrected).

The goal is that insrumetnation can declare stability prior to core semconv declaring stability, but that instrumentation must then maintain its own stability of what it produces. This is the mechanism for how.


### 3. Platform Releases (The Cohesive Whole)

To solve the "cohesive whole" problem and provide obvious version conformance, OpenTelemetry will periodically publish **Platform Releases**.

A **Platform Release** is a manifest (using the schema format from OTEP 4815) that acts as a "BOM" (Bill of Materials). It does not contain new conventions itself but rather lists specific, tested-together versions of federated registries.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this would probably be the forcing factor to update federated registries I mentined in prev comment.
If library A depends on semconv core v1.40 and library B on semconv core v1.140 they probably can't coherently work in the same distro.


**Example Platform Release Manifest (`OpenTelemetry 2026.1`):**

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is awesome!

I also like the year as a major version - we should create expectation of some breaking changes on a predictable cadence

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is date ver no? This is not semver.


```yaml
file_format: platform/1.0.0

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How would federated registries not hosted under opentelemetry interact with the platform release?
Eg a corporate registry declares dependencies on the core otel and jvm registries, could the corporate registry use the platform release manifest as a dependency or would they need to update their own registry dependency manifest to use the platform release versions?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: do you think we have to have a new type of manifest (platform)?

This is essentially publication manifest with import * from all dependencies.
I imagine the core difference is that this is never published as a registry and does not have schema url

name: OpenTelemetry Platform Release
version: 2026.1
registries:
- schema_url: https://opentelemetry.io/schemas/semconv/1.42.0
- schema_url: https://opentelemetry.io/schemas/jvm/2.1.0
- schema_url: https://opentelemetry.io/schemas/gen-ai/1.1.0
```

- **Version Conformance**: A user can say "My application conforms to OpenTelemetry Platform Release 2026.1". This is a much simpler statement than listing 15 different federated registry versions.
Comment thread
dashpole marked this conversation as resolved.
- **Collector Support**: The OpenTelemetry Collector can use a Platform Release manifest to automatically load all necessary schemas and transformations for a specific release.

### 4. Promotion and Consolidation Path

Federated registries follow a standard path toward consolidation to ensure the core specification remains cohesive:

1. **Incubating**: Registry exists outside the core, managed by a specific language-agnostic SIG (e.g., GenAI). It uses a unique namespace, both for schema_url (e.g., `opentelemetry.io/schemas/jvm`) and for signals/attributes (e.g. `jvm`).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This unique-namespace rule does not explain shared cross-cutting conventions. Namespaces such as server, network, error, url, cloud, host, service, process, and os are not naturally tied to one span/metric/log domain, and current instrumentation and resource detectors reuse them across domains.

If the intended atom is the span, metric, or log, where do these shared attribute groups live? If they remain core, the OTEP should say that federated registries depend on core for these groups. If they can themselves federate, the OTEP needs a rule for instrumentation that combines a domain registry with one or more shared registries.

2. **Maturity Progression**: The federated registry progresses through `development` -> `beta` -> `stable` according to its own usage and feedback.
3. **Criteria for Promotion**: To be merged into core `semconv`, a federated registry MUST:
Comment thread
lmolkova marked this conversation as resolved.
- Reach `stable` status, and remain backward compatible for a full year.
- Be available in at least two different stable instrumentation libraries (which may include multiple language implementation).
- Have a formal review and approval from the Semantic Conventions SIG.
4. **Consolidation**: The promoted conventions are merged into the core `semconv` registry.
- A new version of core `semconv` is released (e.g., `v1.50.0`).
- The old federated `schema_url` manifest is updated to simply reexport the new core `semconv` version. This ensures that existing OTLP data continues to work seamlessly with consumers of

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The reexport story needs to be more precise for language artifacts and user discovery. If gen_ai.* starts in a federated Go package and later moves into core semconv/v1.N.0, what happens to the old package's SchemaURL, generated helpers, documentation, and import path? Should the old federated package keep releasing wrappers, expose a moved_to signal, or stop at the last federated version?

Without a programmatic migration/discovery rule, users will not know whether to keep importing the federated package or move to the core semconv package after promotion.

the previous registry.
Comment on lines +135 to +136

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How would we communicate that the federated semconv has merged into core?
How would we ensure that users can discover that further versions are available in core?
Would the federated manifests keep getting new versions for every core semconv version or would it include a flag moved_to?
For sure its repo could show a message in the README and a message in its last release before being archived.
Is this sufficient or should new semconv version in core be programmatically discoverable?


## Success Criteria

- An instrumentation library can overhaul its OTLP output (major version bump) by adopting a new version of a federated registry without requiring a global OpenTelemetry semantic convention version bump.
- Users can use components of OpenTelemetry together, without conflicts in signal definitions or unexpected breaking changes (e.g. those not associated with clear version bumps).
- The core `semantic-conventions` registry remains focused and stable while innovation accelerates in federated registries.

## Open Questions

### 1. How do we prevent namespace collisions between federated registries?

The Semantic Conventions SIG maintains the root `opentelemetry.io/schemas/` namespace. Any new "official" federated registry (e.g., `/jvm`, `/http`) must be an approved OpenTelemetry project and will use tooling provided for federated semantic convention SIGs.

For third-party or experimental registries, authors are encouraged to use their own domains (e.g., `acme.com/schemas/`) to avoid collisions. The `weaver` tool will also validate that a registry does not redefine attributes or signals already present in its dependencies, so any OpenTelemetry registry MUST depend on the core `semantic-conventions` registry.

To aid in discoverability and prevent conflicts, the core `semantic-conventions` repository will maintain a centralized list of all known federated registries. This list can be used by automated tooling to periodically validate all federated registries together, identifying any unintended collisions or running tests against the latest core.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we would essentially own platform release in semconv. The platform release will also ensure that there are no collisions between otel-hosted registries


Comment thread
lmolkova marked this conversation as resolved.
### 2. What happens if two instrumentation libraries depend on different, incompatible versions of the same federated registry?

This is a classic "diamond dependency" problem. OpenTelemetry's Schema v2 (OTEP 4815) handles this via the "latest version wins" resolution at the collector or consumer level, provided the changes are backward compatible. For breaking changes (major version bumps), the telemetry remains unambiguous because each library pins its specific `schema_url`. A consumer (e.g., the Collector) can process both signals independently using the metadata provided in the OTLP `Resource` or `Scope`. This is no worse than the same issue today, where we rely on storage to figure out these conflicts

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

latest version wins is not enough of a resolution rule for language implementations. In Go, semantic convention versions are import paths, not dependency constraints that a solver collapses to one version. A program can import go.opentelemetry.io/otel/semconv/v1.42.0, another package can import v1.43.0, and a future GenAI package might depend on a particular core semconv version.

The OTEP should define what language maintainers expose when a federated registry depends on core 1.42.0 but the rest of an application or instrumentation set uses core 1.43.0. The answer may be a resolved federated schema, a platform-release artifact, or separate package constants, but it needs to be explicit.

and either resolve them or force our queries to be more sophisticated to do so. However, by tagging the data with `schema_url` we could allow storage-time migration and even provide transformation
scripts for major version changes. See [Future Possibilites](#future-possibilities).

### 3. Does this make the Collector configuration more complex?

No. The Schema Transformation Processor has not stabilized, but even in its current iteration, it was designed to work against many possible URLs and versions.

### 4. Why would a federated registry ever want to "promote" to core?

Promotion to core provides the highest level of visibility, stability guarantees, and long-term maintenance by the Semantic Conventions SIG. It also allows other federated semantic convention
registries to use/access its conventions in their own. However, registries that require rapid iteration or are highly niche may choose to remain federated indefinitely.

### 5. Is it a burden for instrumentation maintainers to "own" the stability of federated conventions?

This should not be an additional burden. Stability in OpenTelemetry requires the produced telemetry be unchanging. The only change is leveraging the same definition format and enforcement
tooling (`weaver`) to ensure that stability. We believe that once past initial setup, the overall maintenance burden for instrumentation authors will be less.

### 6. Where is the documentation for all these registries?

The "Platform Release" manifest serves as the primary technical discovery mechanism. We also intend to expand the OpenTelemetry site to include a central "Registry of Registries" where users can browse all approved federated conventions, their stability status, and documentation.

### 7. Does this increase the implementation burden for SDKs and the Collector?

No. Engaging with `schema_url` and federated registries is optional. OpenTelemetry continues to work as-is for users who do not require automated schema transformation or validation. Existing observability ecosystems suffer from these same semantic fragmentation issues today, but they are typically only discovered at the storage or query layer. This proposal provides the metadata necessary to *address* these issues upstream, but it does not mandate that every SDK or Collector component must be schema-aware.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I do not think the implementation burden is optional for language SIGs. Even if SDKs do not perform schema transformations, language maintainers still need to decide how generated semconv packages are published, how users discover which package owns a namespace, how package versions pair with core versions, and which SchemaURL constants instrumentation should use for mixed telemetry.

This should be part of the OTEP's compatibility contract rather than left as language-specific interpretation.


### 8. Won't this lead to "version fatigue" if instrumentation libraries have to major bump frequently to adopt federated registry changes?

No. Instrumentation libraries in OpenTelemetry are subject to the [specification's versioning and stability policies](/specification/versioning-and-stability.md). These policies strongly discourage frequent major version bumps and require minimum support periods (e.g., one year for contrib/instrumentation packages) for older major versions. This inherent bias towards stability ensures that instrumentation libraries do not adopt breaking changes from federated registries at a high cadence. Instead, maintainers will typically batch such changes or only adopt them when the value to users clearly outweighs the significant cost of a major release and the subsequent long-term support requirement.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the problem here is "cost" - the cost to one OTLP backend might be significant - it dictates a business deal being made in a quarter vs losing to a competitor that doesn't comply to Otel at all. This puts vendors that are all in on OTEL at risk as their upstream signals are being dictated by parties that have no actual financial overhead or incentives to move the standards forward.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm also not sure this aligns with the Contrib Stability section of the versioning and stability doc:

Plugins, instrumentation, and other contrib packages SHOULD be kept up to date and compatible with the latest versions of the API, SDK, and Semantic Conventions. If a release of the API, SDK, or Semantic Conventions contains changes which are relevant to a contrib package, that package SHOULD be updated and released in a timely fashion.

If the relevant federated semconv decides to ship new major versions every other Tuesday because they're post-1.x and yet have attributes or telemetry that are in flux then it seems like the instrumentation libraries that depend on it would also be expected to ship new major versions frequently. Maybe that's something we'd want the TC to put a stop to, but it does seem like an expected result of a combined push for "stable semver" and "faster evolution".

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So the idea behind this federation is that the lifecycle of a federated semconv and the instrumentation are aligned. You wouldn't bump one without the other, but you can bump both without bumping core semconv versions or requiring syncing beyond that scope.

The owners of the instrumentation and the owners of the "federated semconv" would be the same set of folks.

The wording in the Contrib Stability section would be updated appropriately here as well.


### 9. Where will federated semantic convention registries reside?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would also be nice to think through where the code generators and generated code would live. Would the existing language generators also track and generate federated repos, or would they need to publish their generation artifacts (e.g. templates) in a way that is consumable (and stable?) for federated semconv publishers to use to generate their own stuff? Presumably we don't want federated publishers to also have to write their own code generators.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code generators - https://github.com/open-telemetry/opentelemetry-weaver-packages

Generated code - perhaps this needs more though. My expectation was it would live beside the instrumentation that exists today. I think that should be sufficient.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Got it. So stuff like https://github.com/open-telemetry/opentelemetry-go/tree/main/semconv/templates/registry/go would need to be replicated in each federated semconv area? Or is go the only ones that have our templates stored in our repo?


It is not yet decided if federated registries should be:

- Embedded as sub-directories within the main `semantic-conventions` repository (sharing infrastructure but maintaining independent lifecycles).
- Hosted in their own dedicated GitHub repositories.
- Nested within the project that produces the telemetry (e.g., `opentelemetry-collector-contrib` hosting its own conventions, or a language-specific instrumentation repository).
- A combination of the above, depending on whether the registry is maintained by a core OpenTelemetry SIG or an external entity.

### 10. How will consumers handle query fragmentation across different registry versions?

If "Service A" is on `jvm/v1.0.0` and "Service B" is on `jvm/v2.0.0` (which has breaking changes), a consumer's dashboard for "JVM Heap" is effectively broken or requires complex `OR` logic in every query.

This is a scenario that exists today in open source observability. As
`schema_url` becomes more widely adopted, we expect backends to support
automatic or semi-automatic (e.g agent-aided) transitions and translations to handle this problem.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

how can we say that backends will use these agent-aided transformations? That seems like something that certain vendors such as companies that have privileged foundation model access a competitive advantage. This seems unfair.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point, and not the real intention here.

The agent-aided meant we may want to start leveraging agents within open-telemetry to define transitions at definition time, and publicizing these transitions for everyoen to consume without agents. We cannot have agent-in-the-loop on hot paths, that's intractable. Leveraging an agent to help improve the coverage of how many version transitions we can safely provide is what this was intended to mean.

The true goal is that we have an open model and easy-to-use transition "definition" that folks can consume to translate between versions of schema, or even (if we're successful) between different schema-urls entirely.

That's still experimental / long-term exploration for the project. For now, we have targeted version-bump transitions as something we believe we can provide automatic transition model that should NOT be costly unfair for the ecosystem to adopt.


### 11. How can a consumer discover the "Semantic Contract" of a service?

As a consumer (e.g., an SRE team), I need a way to know what telemetry a service *promises* to send without waiting for a packet to arrive. We
expect instrumentation libraries to publish the schema URL they use, and
for documentation to be easily discoverable from this.

### 12. What is the impact on telemetry overhead and storage costs?

We may not be able to re-use `InstrumentationScope` in as many places

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should also cover resources, not only InstrumentationScope. Existing Go resource detectors commonly create one resource containing attributes from multiple namespaces: AWS ECS combines cloud.*, container.*, AWS ECS, and AWS log attributes; GCP combines cloud.*, k8s.*, faas.*, host.*, and GCP attributes; Azure VM combines cloud.*, host.*, and os.*; built-in Go SDK providers cover service.*, telemetry.sdk.*, host.*, process.*, os.*, and container.*.

The Go SDK already treats different non-empty resource schema URLs as a merge conflict and returns a schemaless merged resource. If federation can assign different schema URLs to those attribute groups, the OTEP needs to say whether resources use a resolved schema URL, a platform schema URL, no schema URL, or some other rule.

as we do today, due to needing finer-grained `schema_url` tracking. To
know if this is true, we need feedback from instrumentation SIGs on how
they are leveraging instrumentation scope today.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One thing we didn't consider yet is semconv libs generation: whether there should be a semconv lib per federated registry and/or one lib for all applicable registries.

I think a viable approach for language SIGs to have one user-facing lib with a curated list of registries applicable to their ecosystem (e.g. JVM metrics are only important for Java, maybe Kotlin and Android ecosystems but not for Python).

We do not expect significant change.

## Alternatives Considered

### Monolithic Registry with Namespaces

We could keep everything in one repo but using namespaces. This does not solve the coupled versioning problem (major bumps).

### Ad-hoc Federation

Allowing federation without a central "Platform Release" mechanism leads to "dependency hell" for users trying to understand if their components work together.

## Future Possibilities

### Automatic Schema Transformation

Tooling (like `weaver`) could automatically generate the necessary OTLP transformations when a user moves from a Platform Release `2026.1` to `2026.2`. We could also
leverage `weaver`'s MCP server to automatically generate OTLP transformation and configuration today as tooling to help with major version bumps needed in OpenTelemetry

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not familiar with the weaver MCP server. How does this work?

@jsuereth jsuereth Mar 6, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Today it's pretty light. You run weaver mcp and it will load in a registry and allow the agent to interact with a version of semantics and lookup the model, definitions, notes, etc. It can also run live-check to enforce conformance on the version. We hope to expand this further to be more of an aide when defining conventions and allow more ad-hoc agent-initiated flows, e.g. "Help me create a semantic convention registry from this integration test"

instrumentation. This would rely on finer-grained SchemaURLs such that we can tie the transformation to signals generated by a specific library.

### Registry Discovery

A central "Registry of Registries" to discover available conventions, and to advertise conventions from non-OpenTelemetry sources, similar to the instrumentation registry on opentelemetry.io.
Loading