Seldon QA Baseline — blok-intelligence/blok-mcp

[seldonqa]

Seldon QA Baseline — blok-intelligence/blok-mcp

Seldon analysed the default branch @ 7055062 and generated 25 test cases.

Review & edit this plan in Seldon →

Set your target URL, include/exclude cases, edit steps, and run the plan from the Seldon QA editor. Once you approve it there, Seldon reviews every pull request automatically.

---

25 test cases | P0: 13 P1: 12

ID	Priority	Area	Test
TC-001	P0	Authentication	Authentication via whoami tool — valid credentials return user info
TC-002	P0	Authentication	Successful sign-in with valid credentials returns authenticated session
TC-003	P0	Authentication	Sign-in with invalid credentials surfaces a clear 'Invalid email or password' error
TC-004	P0	Authentication	Authentication sign-in endpoint returns a valid access token for correct credentials
TC-005	P0	Authentication / Error Handling	whoami returns descriptive errors for invalid and missing credentials
TC-006	P0	Authentication / Session	Authenticate via whoami with valid credentials and verify session establishment
TC-007	P0	Authentication / Session Management	Session clears on sign-out and user can re-authenticate successfully
TC-008	P0	Experiments / Create & Run	Start experiment: URL normalization, LLM suggestion flow, and Draft→Running transition
TC-009	P0	HTTP Server / Deployment	Health check endpoint returns OK status
TC-010	P0	HTTP Server / Health	Health Check Endpoint Returns 200 with Correct JSON
TC-011	P0	SSE Middleware / Transport	SSE endpoint responds with event-stream content type on GET /sse
TC-012	P0	SSE Middleware / Transport	POST /messages/ is accepted and processed by the SSE message handler
TC-013	P0	Server Configuration / Environment Vari…	Server starts on default PORT 8080 and HOST 0.0.0.0 when env vars are absent
TC-014	P1	API Client	Authenticated API GET request succeeds and returns JSON data
TC-015	P1	Authentication	Authentication failure — invalid credentials return a clear error
TC-016	P1	Authentication	Sign-in with a non-existent email surfaces a 'User not found' error
TC-017	P1	Configuration Management	BLOK_MCP_BLOK_API_URL defaults to https://app.joinblok.co and rejects non-HTTP(S) URLs
TC-018	P1	Experiment Management	Experiment detail page is reachable after authentication
TC-019	P1	Experiment Types / Discovery	list_experiment_types formats output and truncates long instructions at 100 characters
TC-020	P1	Experiments / List & Filter	list_experiments client-side name filtering and multi-alias ID field handling
TC-021	P1	Experiments / Results	get_experiment_results renders correct status-specific output for each experiment state
TC-022	P1	HTTP Server / OAuth	OAuth authorization-server metadata endpoint returns valid OAuth 2.0 discovery document
TC-023	P1	HTTP Server / OAuth Stubs	OAuth Metadata Endpoint Returns Correct Discovery Document
TC-024	P1	HTTP Server / OAuth Stubs	OAuth Authorize and Token Stub Endpoints Return 400 with X-Session-Token Guidance
TC-025	P1	MCP Server / Experiment Results	Experiment Results Metrics Formatting and Truncation

---

_{Generated by Seldon from blok-intelligence/blok-mcp @ 7055062 · Manage in Seldon}