Skip to content

feat: add Hermes Agent with OpenRouter to romeo-2#31

Open
BCNelson wants to merge 1 commit into
mainfrom
feat/hermes-agent-romeo
Open

feat: add Hermes Agent with OpenRouter to romeo-2#31
BCNelson wants to merge 1 commit into
mainfrom
feat/hermes-agent-romeo

Conversation

@BCNelson

Copy link
Copy Markdown
Owner

Summary

  • Add NousResearch Hermes Agent service to romeo-2
  • OpenRouter as primary LLM (hermes-3-405b), smart routing sends simple queries to local Ollama on B580 GPU (qwen3:4b)
  • Make mkHost accept list-valued nixosMods (backward-compatible)
  • Agenix secret for OpenRouter API key

Before deploy

  • Provision OpenRouter API key via agenix-rekey
  • Verify gateway port for nginx proxy setup

Test plan

  • nix build .#nixosConfigurations.romeo-2.config.system.build.toplevel --dry-run (requires .age file)
  • Deploy to romeo-2, verify systemctl status hermes-agent
  • Test hermes chat with OpenRouter model
  • Test smart routing routes simple queries to local Ollama

Add NousResearch Hermes Agent service to romeo-2 with smart model
routing: OpenRouter primary (hermes-3-405b), simple queries auto-route
to local Ollama on B580 GPU (qwen3:4b) to save cost.

- Add hermes-agent flake input
- Make mkHost accept list-valued nixosMods (backward-compatible)
- Configure agenix secret for OpenRouter API key
- Service depends on ZFS mounts and Ollama

Note: OpenRouter API key secret (.age file) needs provisioning via
agenix-rekey before deploy. Nginx proxy TBD pending gateway port
verification.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant