Skip to content

docs: document experimental Switchyard integration#400

Draft
bbednarski9 wants to merge 2 commits into
NVIDIA:mainfrom
bbednarski9:docs/switchyard-experimental
Draft

docs: document experimental Switchyard integration#400
bbednarski9 wants to merge 2 commits into
NVIDIA:mainfrom
bbednarski9:docs/switchyard-experimental

Conversation

@bbednarski9

@bbednarski9 bbednarski9 commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

Overview

Add the public Fern documentation for Relay's experimental Switchyard Decision API plugin. This keeps the functional integration in NeMo Relay #369 separate from its user-facing documentation.

This PR makes the Switchyard configuration page the authoritative user-facing reference for the complete component contract, deployment limitations, and current native-integration boundary.

Experimental: The integration is early access, disabled in default Relay builds, and currently requires a separately running Switchyard service.

  • I confirm this contribution is my own work, or I have the right to submit it under this project's license.
  • I searched existing issues and open pull requests, and this does not duplicate existing work.

Details

  • Add Configure Plugins → Switchyard (Experimental) to the Fern navigation.
  • Organize configuration around the Decision API connection, profile selection, exact Relay-owned backend bindings, and trusted same-protocol defaults.
  • Document every component option, enum, default, and validation constraint, including all six request-materialization modes and the requirement for all three protocol defaults.
  • Provide complete configuration and recommended recipes for observe-only, payload-only request-aware, and ATOF-backed StageRouter routing.
  • Explain fail-open behavior, retry boundaries, streaming commitment, exact target validation, and environment-referenced credential handling.
  • Consolidate the experimental deployment limitations previously spread across crate and example documentation.
  • Clarify that routing decisions and ATOF accumulation use a separately running Switchyard service while provider-protocol translation runs in process through switchyard-translation.
  • Clarify the native-integration boundary: the Rust component is registered by Relay's CLI gateway; Hermes native plugins, LangChain, LangGraph, and Deep Agents receive Switchyard routing only when their provider traffic traverses that gateway.
  • Document the pinned Switchyard topic-branch compatibility commit and identify the examples as manual compatibility and trajectory workflows rather than production orchestration.
  • Keep all examples public-safe, environment-referenced, and free of internal-only provider assumptions.

The docs do not change Relay runtime behavior, configuration schemas, generated API surfaces, or PR #369.

Where should the reviewer start?

  1. docs/configure-plugins/switchyard/configuration.mdx — complete option reference, recipes, runtime behavior, and experimental limitations.
  2. docs/configure-plugins/switchyard/about.mdx — experimental status, ownership boundary, prerequisites, and direct links to the reference and limitations.
  3. docs/index.yml — Fern navigation placement.

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

Validation

  • npx fern check --warnings passed with zero errors; the unauthenticated redirects check was skipped with one warning.
  • npx fern docs broken-links --strict found six pre-existing broken API-reference links in docs/resources/support-and-faqs.mdx and docs/reference/api/index.mdx; no errors point to the Switchyard pages.
  • git diff --check passed.
  • A content audit found no InferenceHub references, internal-only endpoints, literal credentials, local Visor paths, or unpublished test artifacts in the Switchyard Fern pages.

Signed-off-by: Bryan Bednarski <bbednarski@nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented Jul 9, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@coderabbitai

coderabbitai Bot commented Jul 9, 2026

Copy link
Copy Markdown

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Enterprise

Run ID: c57ff6b0-2407-45f5-a929-c76fce8b66c3

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@bbednarski9 bbednarski9 added the experimental Experimental or early-access feature label Jul 9, 2026
@github-actions github-actions Bot added size:M PR is medium Documentation documentation-related labels Jul 9, 2026
@willkill07 willkill07 added this to the 0.6 milestone Jul 10, 2026
Signed-off-by: Bryan Bednarski <bbednarski@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Documentation documentation-related experimental Experimental or early-access feature size:M PR is medium

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants