Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
dba036b
added skeleton.
raeesiarya Apr 11, 2026
7999516
added data
raeesiarya Apr 11, 2026
8ab836a
added prompts
raeesiarya Apr 11, 2026
8ecd932
few changes
raeesiarya Apr 11, 2026
9dd059b
connecting all stuff together now.
raeesiarya Apr 12, 2026
b000e3c
Add comprehensive unit tests for run_audit and equivalence modules
raeesiarya Apr 12, 2026
57484ce
github actions activation
raeesiarya Apr 12, 2026
c59c332
fix
raeesiarya Apr 12, 2026
f2e32a3
chore(ci): update coverage badge
raeesiarya Apr 12, 2026
cf039af
Add comprehensive pytest suite with W&B plot logging (390 tests)
raeesiarya Apr 12, 2026
89592ff
Merge branch '8-add-more-data' into claude/competent-rubin
raeesiarya Apr 12, 2026
80ede28
Merge pull request #10 from raeesiarya/claude/competent-rubin
raeesiarya Apr 12, 2026
e85afc1
added some bash files
raeesiarya Apr 12, 2026
54bd3e0
updated claude.sh
raeesiarya Apr 12, 2026
1ecaf3b
added ai code review, still not working well but it's a start.
raeesiarya Apr 13, 2026
a9aa696
removing claude pr review
raeesiarya Apr 13, 2026
5452e20
changed ordering in setup script
raeesiarya Apr 13, 2026
066907c
Added local logging to audits.
raeesiarya Apr 13, 2026
7b8220d
chore(ci): update coverage badge
raeesiarya Apr 13, 2026
a43a8fa
specified logging
raeesiarya Apr 13, 2026
960e443
added bash scripts for async run of audit
raeesiarya Apr 13, 2026
f967cbd
bug fix
raeesiarya Apr 13, 2026
65cdc27
bug fix
raeesiarya Apr 13, 2026
4574411
updates
raeesiarya Apr 13, 2026
0786207
added csv writing
raeesiarya Apr 15, 2026
2cb3e94
chore(ci): update coverage badge
raeesiarya Apr 15, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
91 changes: 91 additions & 0 deletions .github/workflows/tests.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,91 @@
name: Tests

on:
push:
branches:
- "**"
pull_request:

permissions:
contents: write

jobs:
pytest:
runs-on: ubuntu-latest

steps:
- name: Check out repository
uses: actions/checkout@v4

- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: "3.10"

- name: Install test dependencies
run: |
python -m pip install --upgrade pip
python -m pip install pytest pytest-cov numpy matplotlib python-dotenv tqdm transformers
python -m pip install torch --index-url https://download.pytorch.org/whl/cpu

- name: Run unit tests with coverage
run: |
pytest \
--cov=src/lmlm-audit \
--cov-report=term-missing \
--cov-report=xml \
--cov-report=json

- name: Upload coverage reports
uses: actions/upload-artifact@v4
with:
name: coverage-reports
path: |
coverage.xml
coverage.json

- name: Read coverage percentage
id: coverage
run: |
python - <<'PY'
import json
from pathlib import Path

data = json.loads(Path("coverage.json").read_text())
percent = float(data["totals"]["percent_covered"])
rounded = f"{percent:.0f}%"

if percent >= 90:
color = "brightgreen"
elif percent >= 80:
color = "green"
elif percent >= 70:
color = "yellowgreen"
elif percent >= 60:
color = "yellow"
elif percent >= 50:
color = "orange"
else:
color = "red"

with Path("/tmp/coverage_outputs.txt").open("w") as f:
f.write(f"message={rounded}\n")
f.write(f"color={color}\n")
PY
cat /tmp/coverage_outputs.txt >> "$GITHUB_OUTPUT"

- name: Generate coverage badge
if: github.event_name == 'push'
uses: emibcn/badge-action@v2
with:
label: coverage
status: ${{ steps.coverage.outputs.message }}
color: ${{ steps.coverage.outputs.color }}
path: badges/coverage.svg

- name: Commit coverage badge
if: github.event_name == 'push'
uses: stefanzweifel/git-auto-commit-action@v5
with:
commit_message: "chore(ci): update coverage badge"
file_pattern: badges/coverage.svg
13 changes: 10 additions & 3 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -22,8 +22,15 @@ wheels/
# Weights & Biases
wandb

# Logging
outputs/

# uv
uv.lock

# Claude
/.claude
CLAUDE.md

# Ruflo (Claude)
/.swarm
/.claude-flow
ruvector.db
.mcp.json
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,10 @@
<p align="center">
</p>

<p align="center">
<img src="./badges/coverage.svg" alt="Coverage badge" />
</p>

<p align="center">
<a href="./docs/Auditing_Forgetting_in_Limited_Memory_Language_Models.pdf">Project Proposal</a>
|
Expand Down
20 changes: 20 additions & 0 deletions badges/coverage.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
1 change: 1 addition & 0 deletions coverage.json

Large diffs are not rendered by default.

Loading
Loading