Skip to content

Document Amazon Kinesis operators#328

Open
mavam wants to merge 4 commits into
mainfrom
topic/kinesis
Open

Document Amazon Kinesis operators#328
mavam wants to merge 4 commits into
mainfrom
topic/kinesis

Conversation

@mavam
Copy link
Copy Markdown
Member

@mavam mavam commented May 15, 2026

🔍 Problem

The docs do not cover the Amazon Kinesis operators added in tenzir/tenzir#6188.

🛠️ Solution

  • Add reference pages for from_amazon_kinesis and to_amazon_kinesis.
  • Add an Amazon Kinesis integration page with read, write, IAM, parsing, and LocalStack endpoint examples.
  • Link Kinesis from the Amazon integrations sidebar.

💬 Review

Focus on whether the Kinesis restart semantics, payload handling, and AWS endpoint precedence are clear enough for a first operator version.

⚙️ Code PR: tenzir/tenzir#6188

@github-actions github-actions Bot added reference Reference documentation integration Integration documentation site Site infrastructure labels May 15, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 15, 2026

📦 Preview  ·  View →  ·  🟢 Live

Verified for e06a2e2  ·  Auto-updates on push

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 38d8ba42cc

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment on lines +2 to +4
title: from_amazon_kinesis
category: Inputs/Events
example: 'from_amazon_kinesis "security-events", start="trim_horizon"'
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Register new Kinesis operators in reference index

Additions of from_amazon_kinesis and to_amazon_kinesis are incomplete without updating src/content/docs/reference/operators.mdx (both the frontmatter operators: list and the ReferenceCard sections), so these operators will not appear in the main Operators catalog that users browse from /reference/operators. This makes the new docs effectively undiscoverable unless someone already knows the direct URL.

Useful? React with 👍 / 👎.

@mavam
Copy link
Copy Markdown
Member Author

mavam commented May 15, 2026

@codex review

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 91b0201a8f

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

description: 'Receives messages from an AMQP queue.'
example: 'from_amqp "amqp://admin:pass@0.0.0.1:5672/vhost", queue="events"'
path: 'reference/operators/from_amqp'
- name: 'from_amazon_kinesis'
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Keep from_amazon_kinesis alphabetized in operator index

The insertion order violates the documented index rule in .agents/references/reference-index-pages.md (“Order entries alphabetically within their category section”): from_amazon_kinesis should sort before from_amqp, not after it. This leaves the operators index inconsistent (including the corresponding card section), which makes future index maintenance error-prone and can cause ordering checks/review drift.

Useful? React with 👍 / 👎.

description: 'Sends messages to an AMQP exchange.'
example: 'to_amqp "amqp://admin:pass@0.0.0.1:5672/vhost"'
path: 'reference/operators/to_amqp'
- name: 'to_amazon_kinesis'
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Keep to_amazon_kinesis alphabetized in operator index

This entry is also out of alphabetical order per .agents/references/reference-index-pages.md: to_amazon_kinesis should appear before to_amqp. Keeping it here makes the index ordering inconsistent (and the related card list inconsistent too), which increases maintenance friction and invites follow-up churn whenever the operator index is updated.

Useful? React with 👍 / 👎.

@mavam
Copy link
Copy Markdown
Member Author

mavam commented May 15, 2026

@codex review

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 9936532f72

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".


</ReferenceCard>

<ReferenceCard title="to_amazon_kinesis" description="Sends records to an Amazon Kinesis data stream." href="/reference/operators/to_amazon_kinesis">
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Keep operator cards alphabetized in the index

The new to_amazon_kinesis card is inserted after to_amazon_security_lake, which breaks the required alphabetical ordering for operator index cards. The repository guidance in .agents/references/reference-index-pages.md explicitly requires alphabetical order within each category section, so this placement makes the index harder to maintain and inconsistent with the documented workflow.

Useful? React with 👍 / 👎.

@mavam
Copy link
Copy Markdown
Member Author

mavam commented May 15, 2026

@codex review

@chatgpt-codex-connector
Copy link
Copy Markdown

Codex Review: Didn't find any major issues. 🚀

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

integration Integration documentation reference Reference documentation site Site infrastructure

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant