Skip to content

Harden safety, privacy, and SWE-bench comparisons - #12

Merged
wq19901103wq merged 3 commits into
mainfrom
codex/security-privacy-hardening
Jul 17, 2026
Merged

Harden safety, privacy, and SWE-bench comparisons#12
wq19901103wq merged 3 commits into
mainfrom
codex/security-privacy-hardening

Conversation

@wq19901103wq

Copy link
Copy Markdown
Owner

Summary

  • remove the SWE-bench environment-variable shell bypass and restore safe defaults
  • harden URL fetching, local persistence permissions, backup retention, safety logs, retries, and token budgets
  • make the three-system comparison use issue-only input and equal timeouts
  • add endpoint preflight checks and preserve infrastructure errors instead of recording false benchmark failures

Validation

  • full suite: 346 passed, 3 skipped
  • final security regression suite: 187 passed
  • benchmark/LLM targeted suite: 42 passed
  • ruff and mypy pass

Benchmark status

A fresh three-system smoke run was intentionally aborted before scoring because the shared direct/SWE-agent endpoint returned insufficient_quota. Claude proxy connectivity is healthy. The new preflight now prevents this condition from being recorded as a model failure.

@wq19901103wq
wq19901103wq merged commit 224a490 into main Jul 17, 2026
4 checks passed
@wq19901103wq
wq19901103wq deleted the codex/security-privacy-hardening branch July 17, 2026 20:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant