Skip to content

Other SSE endpoint lacks keepalive and proxy headers #176

Description

@AnthonyRonning

🚩 Other SSE endpoint lacks keepalive and proxy headers

The chat completions SSE endpoint at src/web/openai.rs:380 uses Sse::new(stream).into_response() without any keepalive or x-accel-buffering: no header. If the motivation for this PR is that sparse SSE streams get dropped by proxies/load balancers, the same issue could affect the other SSE endpoint. Consider whether the responses_sse_response helper should be reused there as well.

Open in Devin Review

Was this helpful? React with 👍 or 👎 to provide feedback.

Originally posted by @devin-ai-integration[bot] in #175 (comment)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions