Skip to content

docs: Update streaming instructions for generative AI models#80

Open
Maki-Grz wants to merge 1 commit into
SAP-docs:mainfrom
Maki-Grz:patch-1
Open

docs: Update streaming instructions for generative AI models#80
Maki-Grz wants to merge 1 commit into
SAP-docs:mainfrom
Maki-Grz:patch-1

Conversation

@Maki-Grz

Copy link
Copy Markdown

Documentation improvements for streaming:

  • Clarified that streaming can be enabled for generative AI models to return responses incrementally, not just for Amazon Bedrock models.
  • Specified that for Amazon Bedrock models, streaming is invoked by using the $DEPLOYMENT_URL/invoke-with-response-stream endpoint.
  • Added instructions for enabling streaming with the Converse API by calling the $DEPLOYMENT_URL/converse-stream endpoint instead of /converse.

Ref: #79

Clarified instructions for enabling streaming in generative AI models, including specific endpoints for Amazon Bedrock and Converse API.
@cla-assistant

cla-assistant Bot commented Apr 17, 2026

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@Maki-Grz Maki-Grz marked this pull request as draft April 17, 2026 09:55
@Maki-Grz Maki-Grz marked this pull request as ready for review April 17, 2026 09:57
@helenaaaaaaaaaa helenaaaaaaaaaa added follow-up-with/dev Clarification with development needed. in-discussion This item is being discussed internally labels Apr 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

follow-up-with/dev Clarification with development needed. in-discussion This item is being discussed internally

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants