Skip to content

Run local inference via llama.cpp (request-scoped llama-server), drop the daemon#36

Draft
CoreyRDean wants to merge 3 commits into
mainfrom
claude/llama-cli-local-inference-NaJIq
Draft

Run local inference via llama.cpp (request-scoped llama-server), drop the daemon#36
CoreyRDean wants to merge 3 commits into
mainfrom
claude/llama-cli-local-inference-NaJIq

docs(readme): describe the request-scoped llama-server co-process

9aadab5
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar