feat: add Vertex AI provider for enterprise grade GCP integration#228
feat: add Vertex AI provider for enterprise grade GCP integration#228realtusharnargunde wants to merge 4 commits into
Conversation
Vertex AI can use Application Default Credentials (ADC) without requiring GOOGLE_APPLICATION_CREDENTIALS to be explicitly set. This fixes non-interactive runs that were incorrectly requiring the env var even when ADC is available.
Switch from @langchain/google-vertexai (Gemini) to @anthropic-ai/vertex-sdk (Claude) for the vertexai provider. This enables Claude models via Google Cloud's Vertex AI Model Garden. - Replace @langchain/google-vertexai with @anthropic-ai/vertex-sdk - Use ChatAnthropic with AnthropicVertex client for Vertex AI - Update model options to Claude (Sonnet 4.6, Haiku 4.5, Opus 4.8) - Update tests to reflect Claude model defaults
|
Heads-up: #179 (opened Jul 7) implements the same thing — Claude models via Vertex AI with ADC auth — so maintainers may want to look at the two together. The main design differences, for easier triage:
Happy to consolidate in either direction — if there are ideas here that #179 is missing, I'll gladly fold them in. |
|
Coordination pointer: this overlaps a few other in-flight Vertex PRs — #154 adds Vertex as a Summary of how they relate: #154 (comment) — raising it so the maintainers can settle on one Vertex direction. Happy to help consolidate. |
|
Closing this PR based on direction and progress on others. Cheers |
Enhance OpenWiki to allow Enterprise level readiness via Google Vertex AI integration. As a supported provider, Vertex AI will help enable Claude models via GCP's Model Garden. This allows organizations on GCP to use OpenWiki with their existing cloud infrastructure.
Requirement : How Vertex AI Helps
Usage details. :
For local development :
One-time setup
gcloud auth application-default login
Run OpenWiki
OPENWIKI_PROVIDER=vertexai
ANTHROPIC_VERTEX_PROJECT_ID=my-project
CLOUD_ML_REGION=us-east5
openwiki --init
Interactive Setup
openwiki # Select "Vertex AI" provider, press Enter to use ADC
For CI/CD Setup - work with org policies to facilitate appropriate usage
Vertex AI authentication in CI/CD depends on your organization's policies:
Testing :
