Local ONNX inference (embeddings + first-class classify) and AI-gateway OpenTelemetry improvements#503

Merged

rickcrawford merged 21 commits into

mainfrom

wor-1219-1210-local-inference-otel

Jun 9, 2026

Commits on Jun 9, 2026

feat(classifiers): OnnxEmbedder + all-MiniLM-L6-v2 default (WOR-1220)

rickcrawford
and
claude
committed
feat(classifier-client): add embed() RPC wrapper (WOR-1222)

rickcrawford
and
claude
committed
feat(sidecar): implement Embed RPC backed by OnnxEmbedder (WOR-1221)

rickcrawford
and
claude
committed
feat(ai): local sidecar embedding source for the semantic cache (WOR-1223)

rickcrawford
and
claude
committed
feat(modules): in-process ONNX prompt-injection detector (WOR-1224)

rickcrawford
and
claude
committed
feat(observe): metrics + SOTA usage tracking for local inference, multi-tenant (WOR-1225)

rickcrawford
and
claude
committed
ci: bump Node-20 deprecated actions to node24 versions

rickcrawford
and
claude
committed
docs(WOR-1226): local-inference guide for sidecar + in-process embeddings/classify

rickcrawford
and
claude
committed
style: fmt embedder test assert (WOR-1220 follow-up)

rickcrawford
and
claude
committed
feat(core): wire in-process embedding source for the semantic cache (WOR-1235)

rickcrawford
and
claude
committed
feat(ai): emit derived USD cost on the OTel AI span (WOR-1229)

rickcrawford
and
claude
committed
feat(ai): AI error span semantics (WOR-1231)

rickcrawford
and
claude
committed
test(ai): pin GenAI semconv conformance for AI spans (WOR-1232)

rickcrawford
and
claude
committed
docs(observe): AI-span gen_ai/OpenInference attributes + backend matrix (WOR-1234)

rickcrawford
and
claude
committed
chore(deny): ignore RUSTSEC-2026-0173 (proc-macro-error2 unmaintained)

rickcrawford
and
claude
committed
feat(observe): cost-aware tail-sampling decision (WOR-1230)

rickcrawford
and
claude
committed
feat(observe): Phoenix in the reference stack + cost-aware tail sampling (WOR-1227, WOR-1230)

rickcrawford
and
claude
committed
test+docs+example: comprehensive coverage for the in-process classifier and local cache

rickcrawford
and
claude
committed
feat(ai): capture-gated, redacted prompt content on AI spans (WOR-1228)

rickcrawford
and
claude
committed
test(e2e): span-arrival at a mock OTLP collector (WOR-1233)

rickcrawford
and
claude
committed
chore(config): regenerate schema for the HTTP/3 disabled doc comments

rickcrawford
and
claude
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Local ONNX inference (embeddings + first-class classify) and AI-gateway OpenTelemetry improvements#503

Local ONNX inference (embeddings + first-class classify) and AI-gateway OpenTelemetry improvements#503
rickcrawford merged 21 commits into
mainfrom
wor-1219-1210-local-inference-otel

Commits on Jun 9, 2026

feat(classifiers): OnnxEmbedder + all-MiniLM-L6-v2 default (WOR-1220)

feat(classifier-client): add embed() RPC wrapper (WOR-1222)

feat(sidecar): implement Embed RPC backed by OnnxEmbedder (WOR-1221)

feat(ai): local sidecar embedding source for the semantic cache (WOR-1223)

feat(modules): in-process ONNX prompt-injection detector (WOR-1224)

feat(observe): metrics + SOTA usage tracking for local inference, multi-tenant (WOR-1225)

ci: bump Node-20 deprecated actions to node24 versions

docs(WOR-1226): local-inference guide for sidecar + in-process embeddings/classify

style: fmt embedder test assert (WOR-1220 follow-up)

feat(core): wire in-process embedding source for the semantic cache (WOR-1235)

feat(ai): emit derived USD cost on the OTel AI span (WOR-1229)

feat(ai): AI error span semantics (WOR-1231)

test(ai): pin GenAI semconv conformance for AI spans (WOR-1232)

docs(observe): AI-span gen_ai/OpenInference attributes + backend matrix (WOR-1234)

chore(deny): ignore RUSTSEC-2026-0173 (proc-macro-error2 unmaintained)

feat(observe): cost-aware tail-sampling decision (WOR-1230)

feat(observe): Phoenix in the reference stack + cost-aware tail sampling (WOR-1227, WOR-1230)

test+docs+example: comprehensive coverage for the in-process classifier and local cache

feat(ai): capture-gated, redacted prompt content on AI spans (WOR-1228)

test(e2e): span-arrival at a mock OTLP collector (WOR-1233)

chore(config): regenerate schema for the HTTP/3 disabled doc comments