Hi 👋
First of all, thank you for this amazing project — it's really impressive and promising!
I was wondering if you plan to support LM Studio or Ollama as alternatives to Anthropic?
These tools allow running LLMs locally (like Mistral, LLaMA, etc.) and expose an OpenAI-compatible API, which could make them usable in place of Anthropic.
For users who prefer local, private, and free models, it would be great to have the option to switch to LM Studio or Ollama instead of having to use a paid API key from Anthropic.
Let me know if that could be considered in future versions. I think it would make AgentRails even more accessible to a wider audience 🙏
Thanks again!
Hi 👋
First of all, thank you for this amazing project — it's really impressive and promising!
I was wondering if you plan to support LM Studio or Ollama as alternatives to Anthropic?
These tools allow running LLMs locally (like Mistral, LLaMA, etc.) and expose an OpenAI-compatible API, which could make them usable in place of Anthropic.
For users who prefer local, private, and free models, it would be great to have the option to switch to LM Studio or Ollama instead of having to use a paid API key from Anthropic.
Let me know if that could be considered in future versions. I think it would make AgentRails even more accessible to a wider audience 🙏
Thanks again!