Skip to content

feat: add max chunk size#63

Merged
joeldierkes merged 1 commit into
mainfrom
feat/add-max-chunk-size
Jul 8, 2026
Merged

feat: add max chunk size#63
joeldierkes merged 1 commit into
mainfrom
feat/add-max-chunk-size

Conversation

@joeldierkes

@joeldierkes joeldierkes commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

Note

Medium Risk
SDK 0.77 and ingestion config changes affect how files are chunked and contextualized in production stores; file search now depends on a raw POST path instead of a typed SDK method, so regressions would show up in CLI search and upload behavior rather than compile-time checks alone.

Overview
Extends the CLI for newer store ingestion and search APIs and bumps @mixedbread/sdk from 0.57 to 0.77 (minor CLI release in changeset).

Ingestion controls: store upload and store sync accept --max-chunk-size, validated as a positive integer and passed through upload helpers via new buildFileConfig, which sets max_chunk_size on the upload body (cast on StoreFileConfig because the SDK type does not include that field yet). Upload-related types move from FileCreateParams to StoreFileConfig.

Store creation: store create adds --with-file-context to enable LLM document-level contextualization at create time. buildStoreConfig now builds a ContextualizationConfig object (with_metadata, with_file_context) instead of only true or { with_metadata: fields }, including combining metadata fields with file context.

Search: --file-search no longer calls client.stores.files.search; it POSTs to /v1/stores/files/search with a local response type, since that endpoint is not on the typed client in 0.77.

Tests cover create contextualization combos, sync maxChunkSize wiring, search post calls, and mock file fixtures add content_url for SDK shape updates.

Reviewed by Cursor Bugbot for commit bb04032. Bugbot is set up for automated code reviews on this repo. Configure here.

@joeldierkes
joeldierkes requested review from aavshr and huangrpablo July 8, 2026 20:06
@joeldierkes
joeldierkes merged commit 6872940 into main Jul 8, 2026
4 checks passed
@joeldierkes
joeldierkes deleted the feat/add-max-chunk-size branch July 8, 2026 20:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants