Skip to content

Inprocess default pipeline#2173

Open
jdye64 wants to merge 50 commits into
NVIDIA:mainfrom
jdye64:inprocess-default-pipeline
Open

Inprocess default pipeline#2173
jdye64 wants to merge 50 commits into
NVIDIA:mainfrom
jdye64:inprocess-default-pipeline

Conversation

@jdye64
Copy link
Copy Markdown
Collaborator

@jdye64 jdye64 commented May 29, 2026

Description

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.
  • If adjusting docker-compose.yaml environment variables have you ensured those are mimicked in the Helm values.yaml file.

jdye64 and others added 30 commits May 19, 2026 21:16
@jdye64
Prepare 26.05 release line for 26.05-RC1
a452eb6 
Bump docs, Helm chart metadata, and install snippets from 26.03/26.3.0 to
the 26.05 line and RC1 tag so published artifacts align with user-facing
version references.
@jdye64
Pypi and helm publish fixes
6c2fd4e
@jdye64
Fix PyPI publish wheel path and add artifact listing step
542e995 
upload-artifact flattens nemo_retriever/dist into ./dist on download;
use find instead of ./dist/nemo_retriever/dist/*. Re-run failed jobs
does not pick up workflow changes — dispatch a new run after merging.
@jdye64
Fix PyPI artifact layout and Helm publish idempotency on 26.05
6e47222 
Stage wheels under nemo_retriever/dist in the CI artifact so legacy and new
publish paths both work; resolve wheels from multiple download layouts.
Handle missing NGC chart (create) and duplicate version (skip) in helm script.
@jdye64
Add PyPI build/publish debug logging for artifact layout
96c11fc 
Log pwd, run metadata, directory trees, and glob probe results so CI
failures show whether wheels are missing, mis-staged, or the workflow
YAML is frozen from an older re-run.
@kheiss-uwzoo @greptile-apps
describe Nemotron Parse as alternate PDF extraction method (NVIDIA#2070)
103c271 
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
@kheiss-uwzoo
Merge branch 'main' into 26.05
0dea097
@kheiss-uwzoo @randerzander @greptile-apps
align captioning and chart extraction with Helm NIM topology Fixes: 6…
9190fe5 
…195023, 6195296 (NVIDIA#2074)

Co-authored-by: Randy Gelhausen <rgelhau@gmail.com>
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
@jdye64
Service mode pdf only fix (NVIDIA#2077)
722d553
@charlesbluca
Gate service ffmpeg install at runtime (NVIDIA#2052)
4d698ad 
(cherry picked from commit 13ee35b)
@charlesbluca
Add stable HF PyPI release dispatch (NVIDIA#2075)
881af18 
(cherry picked from commit 050331f)
@charlesbluca
Add PR install smoke for Windows and macOS (NVIDIA#2078)
6c5bb78 
(cherry picked from commit 73f3d5f)
@charlesbluca
Bump OCR nightly train and relax retriever pin (NVIDIA#2080)
a14b5b3 
(cherry picked from commit 2524cfb)
@kheiss-uwzoo
air-gapped deployment for 26.05 (NVBugs 6195103, PR NVIDIA#2052) (NV…
19af4bc 
…IDIA#2082)
@ChrisJar @charlesbluca
Fix video ASR audio demuxing (NVIDIA#2086)
4bfcb40 
(cherry picked from commit 9330be8)
@kheiss-uwzoo
mark non-ingest/query/pipeline retriever subcommands as experimental …
dfd6b38 
…(NVBugs 6199005, 6198526) (NVIDIA#2088)
@jioffe502 @greptile-apps @edknv
Add input-aware retriever ingest routing (NVIDIA#2068)
b3029da 
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
@edknv
silence retriever ingest cli command (NVIDIA#2083)
2b9880d
@jdye64
Helm nemotron parse (NVIDIA#2092)
63dfa90
@kheiss-uwzoo
docs(helm): clarify four core NIMs vs optional Helm NIMs for 26.05 (N…
d25eb24 
…VIDIA#2097)
@jperez999 @charlesbluca
fix asr and ocr on default cpu remote (NVIDIA#2085)
40e9992 
Signed-off-by: Julio Perez <jperez@nvidia.com>
Co-authored-by: Charles Blackmon-Luca <20627856+charlesbluca@users.noreply.github.com>
(cherry picked from commit 7130a72)
@charlesbluca
Fix ASR and media pipeline parameter handling (NVIDIA#2101)
a99479e 
(cherry picked from commit 744f0bc)
@kheiss-uwzoo
docs(extraction): OCR v2 defaults, captioning link, B200 nemotron-par…
794fe97 
…se (26.05, NVBug 6204537) (NVIDIA#2103)
@ChrisJar
Update nemotron parse http interface for nemotron-parse 1.2 (cherry p…
fc53bed 
…ick of NVIDIA#2113) (NVIDIA#2117)
@jdye64
Helm fixes latest (NVIDIA#2121)
cafad31
@jdye64
Helm rerank vl version (NVIDIA#2122)
6309bdf
@jioffe502
Codex/26.05 runmode typing cleanup (NVIDIA#2124)
ca3d676
@jdye64
Nim operator GPU resources fix (NVIDIA#2123)
2005314
@jdye64
Fix detection mode to ensure HTML and Text are honored (NVIDIA#2128)
e63cf74
@mahikaw
Fix .extract() silently dropping unknown kwargs and docs (NVIDIA#2130)
891f1f6
jioffe502 and others added 20 commits May 27, 2026 13:27
@jioffe502
docs: update Retriever constructor examples (NVIDIA#2134)
cb75050
@jdye64
Default to service mode returning the results for the ingestion job (N…
ac41c62 
…VIDIA#2133)
@kheiss-uwzoo
backport: (main --> 26.05)PDF pre-split docs + service-only pdf_split…
52281d8 
…_config note (NVBugs 6218013) (NVIDIA#2126)
@jioffe502
docs: fix graph_pipeline LanceDB examples (NVIDIA#2136)
a4ab4e3
@jdye64
Add OTEL basic support and bump to nemotron-ocr-v2 (NVIDIA#2142)
2edab62
@jdye64
Otel introduction (NVIDIA#2145)
951e0b5
@jperez999
fix versions of cve packages (NVIDIA#2129)
f4e50c4
@jdye64
Asr fixes (NVIDIA#2147)
2df85c5
@jdye64
Fix release source ref issue (NVIDIA#2149)
2271755
@jperez999
add checks against service mode params (NVIDIA#2148)
db2c87d
@jioffe502 @jperez999
Replace ingest input-type routing with manifest branches (NVIDIA#2095)
984140b 
Co-authored-by: Julio Perez <37191411+jperez999@users.noreply.github.com>
@jdye64
Update ASR model to use batch mode and auto-select using batch/stream…
8856a87 
…ing (NVIDIA#2153)
@jperez999
quiet mode default (NVIDIA#2154)
e254e08
@jperez999
update the restricted params for service mode (NVIDIA#2157)
08de78e
@jioffe502
ingest profiles + captioning (NVIDIA#2158)
9da3fb2
@jioffe502
Codex/fail empty root ingest (NVIDIA#2160)
47715ea
@kheiss-uwzoo
fix stale VDB docs (NVBugs 6205401) (NVIDIA#2151)
72a6b61
@jdye64
Adjust service side retention of results based on client desires (NVI…
2853421 
…DIA#2165)
@jdye64
Make inprocess the default implementation for the GraphIngestor, batc…
b169caa 
…h can still be used with a configuration
@jdye64
unit test fixes
86a1e99
@jdye64 jdye64 requested review from a team as code owners May 29, 2026 19:26
@jdye64 jdye64 requested a review from nkmcalli May 29, 2026 19:26
@copy-pr-bot
Copy link
Copy Markdown

copy-pr-bot Bot commented May 29, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@nkmcalli nkmcalli Awaiting requested review from nkmcalli nkmcalli is a code owner automatically assigned from NVIDIA/nv-ingest-maintainers

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

8 participants

@jdye64 @kheiss-uwzoo @charlesbluca @ChrisJar @jioffe502 @edknv @jperez999 @mahikaw