fix: route tinfoil sends to the assigned enclave and cut GLM latency - #1170

Merged

ital0 merged 23 commits into

mainfrom

italomenezes/thu-758-prewarm-tinfoil-attestation-when-a-confidential-model-is

Jul 31, 2026

Commits on Jul 30, 2026

feat: prewarm tinfoil attestation when a confidential model is selected
ital0
committed

Commits on Jul 31, 2026

perf: keep the prompt prefix stable so the tinfoil router cache can hit
ital0
committed
perf: warm the enclave connection and cache session cookies in the tinfoil proxy
ital0
committed
fix: keep backend keep-alive above the alb idle timeout to stop stray 502s
ital0
committed
fix: keep the user turn last by placing volatile notes before it
ital0
committed
fix: log client aborts as 499 and allow keep-warm restarts
ital0
committed
revert: drop the session cookie cache to keep device revocation instant
ital0
committed
fix: route tinfoil requests to the atc-assigned enclave to stop key-config 422s
ital0
committed
fix: preserve the enclave api path prefix when routing to the assigned host
ital0
committed
chore: measure pre-handler latency on the tinfoil proxy path
ital0
committed
chore: expose cross-origin timing so browsers can decompose request latency
ital0
committed
chore: expose the server-timing header to cross-origin clients
ital0
committed
fix: keep system content contiguous so anthropic requests stop failing
ital0
committed
perf: cache cors preflights instead of re-checking every five seconds
ital0
committed
chore: measure inference latency and surface upstream retry attempts
ital0
committed
fix: keep the enclave connection warm for the host traffic actually uses
ital0
committed
fix: carry volatile system notes into continuation steps
ital0
committed
chore: instrument upstream attempts for every inference provider
ital0
committed
docs: correct where per-send system notes are placed
ital0
committed
fix: echo the request origin when credentials and wildcard cors combine
ital0
committed
docs: restore the prompt-injection rationale for note ordering
ital0
committed
fix: shorten the cors preflight cache to bound stale policy windows
ital0
committed
test: align the preflight cache expectation with the shortened max-age
ital0
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

fix: route tinfoil sends to the assigned enclave and cut GLM latency - #1170

fix: route tinfoil sends to the assigned enclave and cut GLM latency#1170
ital0 merged 23 commits into
mainfrom
italomenezes/thu-758-prewarm-tinfoil-attestation-when-a-confidential-model-is

Commits on Jul 30, 2026

feat: prewarm tinfoil attestation when a confidential model is selected

Commits on Jul 31, 2026

perf: keep the prompt prefix stable so the tinfoil router cache can hit

perf: warm the enclave connection and cache session cookies in the tinfoil proxy

fix: keep backend keep-alive above the alb idle timeout to stop stray 502s

fix: keep the user turn last by placing volatile notes before it

fix: log client aborts as 499 and allow keep-warm restarts

revert: drop the session cookie cache to keep device revocation instant

fix: route tinfoil requests to the atc-assigned enclave to stop key-config 422s

fix: preserve the enclave api path prefix when routing to the assigned host

chore: measure pre-handler latency on the tinfoil proxy path

chore: expose cross-origin timing so browsers can decompose request latency

chore: expose the server-timing header to cross-origin clients

fix: keep system content contiguous so anthropic requests stop failing

perf: cache cors preflights instead of re-checking every five seconds

chore: measure inference latency and surface upstream retry attempts

fix: keep the enclave connection warm for the host traffic actually uses

fix: carry volatile system notes into continuation steps

chore: instrument upstream attempts for every inference provider

docs: correct where per-send system notes are placed

fix: echo the request origin when credentials and wildcard cors combine

docs: restore the prompt-injection rationale for note ordering

fix: shorten the cors preflight cache to bound stale policy windows

test: align the preflight cache expectation with the shortened max-age