chore(evaluator): vendor code-evaluator + float-tol + scicode support

[jack-scitix-ai]

Type

• chore — CI, tooling, dependencies, config

Summary

• Convert code-evaluator from a git submodule (submodules/code-evaluator → scitix/code-evaluator) to a self-contained vendored copy under vendor/code-evaluator, byte-identical to the previously pinned commit e4802268. A plain git clone is now self-contained (no git submodule update). Requested in review.
• Port float-tol (fix/checker-messages-float-tol, cfc47d8): clearer LiveCodeBench output-comparison messages + opt-in float tolerance via CODE_EVAL_FLOAT_TOL (default off = exact ==, matching official LiveCodeBench).
• Add SciCode execution support: route source="scicode" through the direct-run path, add requirements/scicode.txt (numpy/scipy/sympy/matplotlib, pinned) and docker/Dockerfile.scicode (python:3.11-slim, since scipy 1.16.x needs Python ≥ 3.11). venv install remains supported.
• Retarget ruff/ty/mypy exclude from submodules/ to vendor/ so the vendored third-party code isn't linted/type-checked.
• Provenance recorded in vendor/code-evaluator/VENDORED.md; code-evaluator is an internal scitix repo with no separate LICENSE. No AI-generated Python modules in this PR (vendored third-party + config/docs only).
• The sieval-side SciCode dataset/task lands in a follow-up PR that depends on this one.

Test Plan

Automated

• Lint/format clean (ruff check && ruff format --check)
• Type check clean (ty check or mypy --strict)
• Unit tests pass (pdm run pytest)

Manual

• ty check sieval clean; ruff/format clean with vendor/ excluded; pdm run pytest tests/unit → 2379 passed. Vendored tree verified byte-identical to e4802268 (+ documented float-tol/scicode patches); app/*.py compile; source="scicode" alias present.

Checklist

Required (all PRs)

• PR title follows conventional format (type(scope): description)
• No internal paths, credentials, or personal info in committed files
• AI-generated code has AI-Generated Code - <model> (<provider>) in module docstring
• No new upper-layer dependencies added to core/
• Deleted code verified — no remaining call sites depend on it

[ethan-scitix]

Bug (blocking): Dockerfile:21 — COPY submodules /app/submodules is now dangling.
This PR removes submodules/ (gitlink + .gitmodules) but doesn't touch the Dockerfile. A fresh clone has no submodules/, so docker build fails on this line — defeating the PR's "self-contained clone" goal. It only builds locally because of an untracked leftover. The image bundles the eval service (L9 installs fastapi[standard]+psutil, which sieval itself doesn't use), so fix to COPY vendor /app/vendor (and update the launch path). Please pull the Dockerfile into this PR.

---

Question: float-tol paths disagree on "integer expected value" (vendor/code-evaluator/app/exec_py_test.py). _decimals_match (stdio) is value-based (b.to_integral_value() → 1.0 treated as integer, exact), while _value_close (fn-call, L54) is type-based (isinstance(b, int) → float 1.0 gets tolerance). Same logical 1.0 compares exact in one path, tolerant in the other. Opt-in only (default off) and byte-identical to upstream cfc47d8, so not blocking — worth aligning upstream or noting in _value_close's docstring that it keys off type.

---

Nit: VENDORED.md is bloated + partly wrong — slim it to provenance or drop it. Keep only what git can't: upstream URL + pinned SHA + patch list with source commits. Current issues: "internal scitix repo" is wrong (scitix/code-evaluator is public); the modifications list omits README.md (also patched); the service description and scipy/Python-3.11 note duplicate the vendored README and the requirements/scicode.txt + Dockerfile.scicode comments.

[jack-scitix-ai]

Thanks — all three addressed:

1. Blocking: dangling COPY submodules (root Dockerfile:21) — fixed

• COPY submodules /app/submodules → COPY vendor /app/vendor. A fresh clone now builds (context has vendor/, no submodules/).
• Retargeted the outer-sibling dir set in scripts/check_layer_imports.py (submodules → vendor) for parity with the ruff/ty/mypy/pre-commit excludes.
• Runtime launch path becomes /app/vendor/code-evaluator/app/server.py. Nothing in-repo references the old path (no CMD/launcher), so this is just a heads-up for whoever runs the image.

2. float-tol type-vs-value discrepancy — noted in docstring

• Added a note to _value_close that it keys "integer expected" off Python type (isinstance(b, int)), while _decimals_match keys off value (b.to_integral_value()) — so 1.0 is exact in stdio but tolerant in fn-call. Behavior left as-is (opt-in, default off, inherited from cfc47d8); worth aligning upstream separately.

3. VENDORED.md slim + corrections — done

• Trimmed to provenance only: upstream URL + pinned SHA + patch list.
• Removed the incorrect "internal repo" framing (it's the public scitix/code-evaluator).
• Added README.md to the patch list (it was patched too).
• Dropped the service description and scipy/Python-3.11 note (they duplicated the vendored README / requirements/scicode.txt / Dockerfile.scicode comments).

[ethan-scitix]

Re-reviewed — the three earlier items are all resolved (Dockerfile COPY vendor, the _value_close type-vs-value docstring note, and VENDORED.md slimmed to provenance). I also verified the vendored tree is byte-identical to e4802268 except the documented patches, and that the exec_py_test.py float-tol patch matches cfc47d8 (differs only by the docstring note). LGTM.

Pushing two tiny, non-blocking maintainer follow-ups straight to the branch so this doesn't need another round-trip — both are comment/config-only, no behavior change:

1. .dockerignore — dropped the now-dead .gitmodules entry (the file is deleted in this PR). Just clearing the last submodule trace.
2. vendor/code-evaluator/app/exec_py_test.py — the _value_close docstring said the tolerance behavior is "inherited from upstream cfc47d8", but cfc47d8 lives on the ethan-scitix/code-evaluator fork branch fix/checker-messages-float-tol, not canonical scitix/code-evaluator. Reworded to "vendored patch … (fork branch …; see VENDORED.md)" so a future reader searching the canonical repo isn't sent on a wild goose chase.

On fastapi[standard]+psutil in the root Dockerfile: confirmed those are for the vendored code-evaluator service (app/server.py), not dead weight — leaving as-is.

Will approve once the branch updates.