Skip to content

Restructure package deps, add CI, fix lint#7

Merged
shreyasrajesh0308 merged 6 commits into
mainfrom
refactor/package-cleanup
Mar 11, 2026
Merged

Restructure package deps, add CI, fix lint#7
shreyasrajesh0308 merged 6 commits into
mainfrom
refactor/package-cleanup

Conversation

@shreyasrajesh0308

Copy link
Copy Markdown
Collaborator

Summary

  • Restructure pyproject.toml: Split 46 flat dependencies into 15 core deps + optional extras ([training], [viz]). Core now includes only what's needed for Operator + Reconciler + Aggregator + QA.
  • Guard optional imports: import gsw_memory no longer crashes when evaluation deps are missing.
  • Fix all lint/format issues in src/: 130 auto-fixed lint errors, 30 files reformatted. src/ now passes ruff check and ruff format --check cleanly.
  • Add CI workflow: Lint, format, test, and build verification run on every PR to main.
  • Fix Claude Code Review permissions: Review workflow can now post comments on PRs.

Dependency changes

Core (always installed): openai, bespokelabs-curator, faiss-cpu, langchain-voyageai, together, scikit-learn, pandas, pyarrow, pydantic, rank-bm25, numpy, python-dotenv, pyyaml, rich, tqdm

Moved to [training] extra: torch, vllm, unsloth, flash-attn, peft, trl, wandb, hydra-core, omegaconf

Moved to [viz] extra: plotly, streamlit, ipykernel, ipywidgets

Removed entirely: google-genai, hdbscan, openpipe-art, editables, hatchling (not runtime deps)

Test plan

  • CI passes (lint, format, test, build)
  • uv sync installs cleanly with core deps only
  • import gsw_memory works without optional deps
  • Existing playground scripts still work with uv sync (full env)

Generated with Claude Code

shreyasrajesh0308 and others added 6 commits March 10, 2026 18:50
Core deps (15) include only what's needed for Operator + Reconciler +
Aggregator + QA: openai, curator, faiss-cpu, voyageai, together,
pandas, pyarrow, scikit-learn, etc.

Heavy deps (torch, vllm, unsloth, flash-attn, wandb, etc) moved to
[training] extra. Viz deps (plotly, streamlit) moved to [viz] extra.

For GPU FAISS, install faiss-gpu in place of faiss-cpu at install time.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Evaluation imports (TulvingBenchEvaluator, hipporag_eval) are now
wrapped in try/except so import gsw_memory doesn't crash when
optional evaluation dependencies are missing.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
- Replace wildcard import in prompts/__init__.py with explicit imports
- Remove unused variable in visualization.py
- Auto-fix 130 lint issues (unused imports, f-strings without placeholders)
- Run ruff format on all 30 files that needed it

src/ now passes both ruff check and ruff format --check cleanly.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Runs on every push to main and PR targeting main:
- Lint: ruff check on src/ (not playground)
- Format: ruff format --check on src/
- Test: pytest on tests/
- Build: verify package installs and imports cleanly

All three jobs run in parallel for faster feedback.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Changed pull-requests permission from read to write so the review
workflow can actually post review comments on PRs.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
The claude-code-action requires github_token to be explicitly passed
for the app token exchange to work correctly during OIDC validation.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@shreyasrajesh0308
shreyasrajesh0308 merged commit b20a19b into main Mar 11, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant