Skip to content

fix: explicitly stop models to prevent concurrent loading errors - #37

Open
marcelrv wants to merge 2 commits into
aidatatools:mainfrom
marcelrv:patch-1
Open

fix: explicitly stop models to prevent concurrent loading errors#37
marcelrv wants to merge 2 commits into
aidatatools:mainfrom
marcelrv:patch-1

Conversation

@marcelrv

@marcelrv marcelrv commented Mar 6, 2026

Copy link
Copy Markdown

Explicitly calls ollama stop after each run to ensure memory is freed. This prevents the benchmark from failing on systems where Ollama attempts to load multiple models simultaneously, which otherwise leads to resource exhaustion and prevents completion.

Explicitly calls ollama stop after each run to ensure memory is freed. This prevents the benchmark from failing on systems where Ollama attempts to load multiple models simultaneously, which otherwise leads to resource exhaustion and prevents completion.

@chuangtc chuangtc left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The fix is safe to merge if your ollama is reasonably recent (≥0.1.24). But it would be more robust with check=False or a try/except.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants