Skip to content

feat: add async and batch retrieval to VortexRAGRetriever#6

Merged
vignesh2027 merged 1 commit into
vignesh2027:mainfrom
vaishnavidesai09:feat/async-batch-retriever
Jun 24, 2026
Merged

feat: add async and batch retrieval to VortexRAGRetriever#6
vignesh2027 merged 1 commit into
vignesh2027:mainfrom
vaishnavidesai09:feat/async-batch-retriever

Conversation

@vaishnavidesai09

Copy link
Copy Markdown
Collaborator

Extends the LangChain integration from #4 with async and batch support.

What's added

  • aget_relevant_documents() / ainvoke() — async retrieval via ThreadPoolExecutor
  • batch(queries) — concurrent sync batch retrieval
  • abatch(queries) — concurrent async batch via asyncio.gather
  • max_workers param for thread-pool tuning
  • _executor initialised in model_post_init for Pydantic v2 compatibility

Tests

10 new tests in tests/test_async_batch_retriever.py. All 23 pass.

Closes #4

@vaishnavidesai09

Copy link
Copy Markdown
Collaborator Author

Hi @vignesh2027! Thanks for the detailed setup instructions and the reference implementation — it made it easy to understand the design.

I've extended the integration with async and batch support as you suggested:

  • aget_relevant_documents() / ainvoke() — non-blocking async retrieval via ThreadPoolExecutor
  • batch(queries) — concurrent sync batch retrieval
  • abatch(queries) — concurrent async batch via asyncio.gather
  • max_workers param for thread-pool tuning
  • Fixed a Pydantic v2 compatibility issue with _executor in model_post_init

All 23 tests pass. Happy to make any changes based on your feedback!

@vaishnavidesai09 vaishnavidesai09 force-pushed the feat/async-batch-retriever branch from 8feef88 to 1863cb5 Compare June 24, 2026 09:06
Signed-off-by: Vaishnavi Desai <vaishnavidesai957@gmail.com>
@vignesh2027 vignesh2027 merged commit 301beb6 into vignesh2027:main Jun 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add LangChain integration — VortexRAGRetriever

2 participants