test: CLI integration test suite with JWT agent support (TC-001–TC-028)

[m-golovchin]

Summary

This PR introduces a comprehensive integration test suite for the CodeMie Code CLI, covering CLI management commands, SSO/JWT-authenticated agent sessions, interactive PTY sessions, and budget/model queries (TC-014 through TC-028). It also includes the minimal production code changes required to make those test scenarios work end-to-end.

---

Production Source Code Changes

1. src/utils/auth.ts — JWT branch in getAuthenticatedClient

What: Added a JWT-specific code path at the top of getAuthenticatedClient. When config.authMethod === 'jwt', the function reads the token from the configured env var (defaulting to CODEMIE_JWT_TOKEN) or from config.jwtConfig.token, constructs an AuthConfig with tokenGetter: async () => token, and instantiates all SDK services, composing them into a CodeMieClient-shaped object.

Why: getAuthenticatedClient was SSO-only. Any CLI command that called it would attempt a browser-session cookie flow and fail in CI environments that only carry a JWT token.

Why this approach: The tokenGetter pattern was already in use in src/cli/commands/assistants/chat/index.ts. Adopting it in auth.ts follows established codebase precedent. The JWT branch only executes when authMethod === 'jwt', leaving the entire SSO path untouched.

---

2. src/cli/commands/assistants/chat/index.ts + types.ts — --jwt-token flag on assistants chat

What: Added --jwt-token <token> as a Commander option. When the flag (or CODEMIE_JWT_TOKEN env var) is present, the command builds a minimal AssistantService-only client inline with tokenGetter, bypassing getAuthenticatedClient entirely.

---

3. src/providers/plugins/jwt/jwt.models.ts + index.ts — JWTModelProxy

What: New class JWTModelProxy implementing ProviderModelFetcher. Registers itself against the bearer-auth provider so codemie models list works for JWT users (TC-022).

---

4. src/cli/commands/models.ts — Remove bearer-auth from UNSUPPORTED_PROVIDERS

What: Removed 'bearer-auth' from the UNSUPPORTED_PROVIDERS set. Required alongside JWTModelProxy so the guard no longer exits early for JWT profiles.

---

5. src/providers/plugins/jwt/jwt.template.ts — agentHooks for extension install and --plugin-dir

What: Added agentHooks block with *.beforeRun (installs CodeMie extension) and claude.enrichArgs (injects --plugin-dir). JWT profiles were missing the extension-install wiring the SSO template already had.

---

6. src/utils/config.ts — CODEMIE_HOME respected in loadAssistantsByScope

What: Changed global-scope base directory from os.homedir() to process.env.CODEMIE_HOME ?? os.homedir() so integration tests using isolated temp dirs see test-injected assistant configs instead of the developer's real ones.

---

7. src/utils/errors.ts — Guard against empty wrapText result in formatErrorForUser

What: Added a guard so an empty wrapText result falls back to context.error.message || '(unknown error)' instead of printing undefined.

---

8. src/env/types.ts — authServerUrl and authRealm on ProviderProfile

What: Added two optional fields to ProviderProfile for potential future use.

---

Test Infrastructure

Auth model — CI_IS_LOCAL_RUN dual-mode

Tests gate on the CI_IS_LOCAL_RUN env flag:

Value	Mode	Auth mechanism
true (default)	SSO / local dev	Existing sso-autotest profile in ~/.codemie
false	JWT / CI pipeline	Bearer token fetched from CI_CODEMIE_AUTH_URL

Integration test files

File	Coverage
agent-task.test.ts	TC-016: --task exit code and stdout
agent-task-session.test.ts	Session and metrics artefact validation
agent-model.test.ts	TC-020, TC-021, TC-022, TC-024: model selection, metrics, models list, /model PTY
agent-skills.test.ts	TC-025: skill slash command invocation (PTY)
agent-assistant.test.ts	TC-014, TC-015, TC-026: assistant setup wizard and chat
agent-jwt-token.test.ts	TC-017, TC-027: --profile + --jwt-token override [JWT-only]
agent-jwt-budget.test.ts	TC-028: all-budget project profile [JWT-only]
agent-negative.test.ts	TC-018: invalid JWT [JWT-only]; TC-019: no profile/token [dual-mode]
agent-shortcuts.test.ts	Slash command smoke tests
cli-commands/*.test.ts	Doctor, help, version, list, profile, skills, workflow, error-handling

Test helpers

File	Purpose
tests/helpers/jwt-auth.ts	fetchJwtToken(), writeJwtProfile(), jwtCleanEnv()
tests/helpers/sso-auth.ts	writeSsoProfile(), ssoCleanEnv(), copySsoCredentials(), setup/teardown
tests/helpers/pty-session.ts	PTY wrapper around node-pty for interactive session testing
tests/helpers/metrics.ts	getLatestMetricsRecord() helper
tests/helpers/test-env.ts	getTestEnvFlagOrDefault()
tests/helpers/session-poll.ts	pollForSession() with timeout

Test setup / config

File	Purpose
tests/setup/load-test-env.ts	Loads .env.test.local before each test file
tests/setup/agent-build-setup.ts	Vitest globalSetup: npm run build, claude install, SSO credential validation with auto-login
env.test.local.example	Template for local developer test configuration

Vitest workspace config

vitest.config.ts uses defineConfig + defineProject to define three named projects in a single file:

Project	Includes	GlobalSetup
unit	src/**/*.test.ts	none
cli	tests/integration/**/*.test.ts (excl. agent-*)	none
agent	tests/integration/agent-*.test.ts	agent-build-setup.ts (build + SSO auth)

npm scripts

Script	What it runs
npm run test:unit	unit project only
npm run test:integration	cli project only (no network auth)
npm run test:integration:cli	cli project only
npm run test:integration:agent	agent project (requires SSO or JWT credentials)
npm run test:run	unit + cli (no agent)
npm run test:all	unit → cli → agent sequentially

---

Test Plan

• npm run test:unit — all unit tests pass (no credential requirement)
• npm run test:integration:cli — CLI management tests pass (no credential requirement)
• For SSO (local dev): ensure valid sso-autotest profile in ~/.codemie or run — credentials are auto-validated and browser login is triggered if expired
• For JWT (CI): populate .env.test.local per env.test.local.example with CI_IS_LOCAL_RUN=false and JWT credentials
• npm run test:integration:agent — agent tests pass against a live CodeMie environment

[codemie-ai]

[AUTO_CLOSE_WARNING] 🔒 This pull request was automatically closed after being older than 30 days with no activity. Contact maintainers to reopen if needed.