Data Analysis Agent v0.1 — Phase 1: CSV Upload + Question → Answer + Chart#90

Closed

madhyamakist wants to merge 55 commits into

mainfrom

feature/data-analysis-agent-v0.1

Commits on Jun 15, 2026

phase-1: domain models + SQLite schema — gate PASSED (11/11 tests)

authored and
Tamoghna Biswas
committed
phase-2: stubbed agent loop + UI + README — gate PASSED (16/16 tests)

authored and
Tamoghna Biswas
committed

Commits on Jun 16, 2026

switch LLM provider from Gemini SDK to OpenRouter (openai-compatible)

authored and
Tamoghna Biswas
committed
track token usage, API request count, and estimated cost per query

authored and
Tamoghna Biswas
committed
redesign UI: Inter font, indigo palette, cleaner layout throughout

authored and
Tamoghna Biswas
committed
phase-3: replace single-shot analysis with iterative SQL ReAct loop

authored and
Tamoghna Biswas
committed

Commits on Jun 17, 2026

spec: encode ReAct loop pattern as non-negotiable rule in base harness

authored and
Tamoghna Biswas
committed
spec: redesign around modular tool registry + data sources as primary entity

authored and
Tamoghna Biswas
committed
phase-3: tool registry + data sources as primary entity (21/21 tests pass)

authored and
Tamoghna Biswas
committed
phase-3: sessions ↔ data sources many-to-many + unified home page (22/22 tests)

authored and
Tamoghna Biswas
committed

Commits on Jun 18, 2026

fix agent loop, add async query execution and structured logging

authored and
Tamoghna Biswas
committed

Commits on Jun 20, 2026

deploy: Docker + GitHub Actions CI/CD + Render config; fix ReAct loop + UI form

authored and
Tamoghna Biswas
committed
ci: read DATAANALYSIS_OPENROUTER_API_KEY from GH Actions secret

authored and
Tamoghna Biswas
committed

Commits on Jun 21, 2026

spec: add Tool Registry and Capability Dispatch to engineering harness (Section 11)

authored and
Tamoghna Biswas
committed

Commits on Jun 22, 2026

feat: add Database class with SQLite/PostgreSQL backend switching

authored and
Tamoghna Biswas
committed
chore: add psycopg2-binary as core dependency for PostgreSQL support

authored and
Tamoghna Biswas
committed
feat: convert uploads to Parquet, store schema metadata in master DB

authored and
Tamoghna Biswas
committed
refactor: stream uploads directly to Parquet, no raw file written to disk

authored and
Tamoghna Biswas
committed
feat: LLM-generated tool and capability descriptions on upload

authored and
Tamoghna Biswas
committed
feat: add Sync button to re-generate tool descriptions via LLM

authored and
Tamoghna Biswas
committed
refactor: modularise codebase — one responsibility per file, methods <=25 lines

authored and
Tamoghna Biswas
committed

Commits on Jun 23, 2026

phase-0: formalize tool layer as MCP in the spec; add mcp + duckdb deps

authored and
Tamoghna Biswas
committed
phase-1: drop Tool/ToolCapability tables; move descriptions onto data_sources

authored and
Tamoghna Biswas
committed
phase-2: add per-source DuckDB MCP server + per-run client pool (isolated)

authored and
Tamoghna Biswas
committed
phase-3: cut the agent graph over to async MCP + DuckDB; delete SQLite-load path

authored and
Tamoghna Biswas
committed

Commits on Jun 25, 2026

spec: reframe session as long-lived agent context (per-session MCP pool + memory)

authored and
Tamoghna Biswas
committed
phase-B: relocate MCP code under tools/ (no behavior change)

authored and
Tamoghna Biswas
committed
phase-C: session-scoped MCP pool + 3-step ReAct loop (no load_data)

authored and
Tamoghna Biswas
committed
phase-D: durable per-session agent memory via LangGraph SqliteSaver

authored and
Tamoghna Biswas
committed
phase-0: spec rewrite — tool = named multi-table dataset (URI), two-level addressing

authored and
Tamoghna Biswas
committed
phase-1: dataset data model — DatasetTableRow child + uri/sync/error cols + migration

authored and
Tamoghna Biswas
committed
phase-2: dataset connector seam (uri, base, parquet) + build_dataset_server

authored and
Tamoghna Biswas
committed
phase-3: pool + addressing cutover to datasets (two-level tool/capability)

authored and
Tamoghna Biswas
committed
phase-4: datasets API — named upload, add-csv, sync-all, delete-dir, connection-check

authored and
Tamoghna Biswas
committed
phase-5: UI for datasets — named upload + type chooser, dataset cards, add-csv

authored and
Tamoghna Biswas
committed
phase-6: PostgresConnector (external datasets, BETA, flag-gated)

authored and
Tamoghna Biswas
committed
docs/ops: README + env for the dataset model; datasets_dir on the persistent disk

authored and
Tamoghna Biswas
committed
phase-0: rewrite spec for the MCP-server model (tools/resources/prompts children)

authored and
Tamoghna Biswas
committed
phase-A: MCP-server entity + sync pipeline + JSON-RPC dispatch + single-level agent

authored and
Tamoghna Biswas
committed
docs: README for the MCP-server model; fix stale GEMINI->OPENROUTER env var

authored and
Tamoghna Biswas
committed
phase-B-spec: mutation methods (additive cascade) + hybrid agent addressing

authored and
Tamoghna Biswas
committed
phase-B: granular MCP mutation methods (additive cascade) + hybrid agent tools

authored and
Tamoghna Biswas
committed
phase-B-review: block DuckDB file-read functions; patch-update + protect schema resource

authored and
Tamoghna Biswas
committed

Commits on Jun 27, 2026

phase-B-ui: SPA shell + multi-connector + Load-more pagination; fix 4 UI issues

authored and
Tamoghna Biswas
committed
phase-B-ui: cursor pagination + AJAX-loaded lists with Previous/Next; remove api/fragments.py

authored and
Tamoghna Biswas
committed
phase-B-ui: chat thread = infinite scroll (cursor-based), not Previous/Next

authored and
Tamoghna Biswas
committed

Commits on Jun 28, 2026

fix: add pytz dependency so DuckDB can materialize timestamptz values

authored and
Tamoghna Biswas
committed
refactor: consolidate mcp_tools/prompts/resources JSON columns

authored and
Tamoghna Biswas
committed
phase-B-ui: remove top Analyse/Database tabs — Inspect opens the DB view

authored and
Tamoghna Biswas
committed
scaffold: data-analysis-agent spec + .env.example + gitignore
madhyamakist
committed
phase-1: CSV upload → LangGraph analysis → text answer + Plotly chart

madhyamakist
and
claude
committed
phase-B-ui: sessions sidebar + MCP capabilities become overlay sliders

authored and
Tamoghna Biswas
committed
fix: dialect-aware SQL for McpResourceRow.kind hybrid expression

authored and
Tamoghna Biswas
committed
merge: harness v0.2.x updates from origin — zero-shot-build/fix/sync, harness/ restructure

authored and
Tamoghna Biswas
committed
phase-B-ui: show loading overlay in modals on Save

authored and
Tamoghna Biswas
committed