Problem
The audit conformance test generated by scitex-dev ecosystem write-audit-test calls scitex_dev.testing.audit_all_for_package(pkg) with the default timeout=120.0. In figrecipe's pytest-matrix CI (apptainer SIF, coverage instrumentation + parallel load), scitex-dev ecosystem audit-all figrecipe deterministically exceeds 120s and raises subprocess.TimeoutExpired, failing the matrix on all 3 pythons (2544 other tests pass).
- Standalone
audit-all runs clean in ~55s.
- Under the matrix SIF load it tips over 120s every run (confirmed across original + full reruns).
- Not a hang, not violations — just slow under load past a too-tight cap.
Immediate workaround (in figrecipe)
Hand-edited the generated test to audit_all_for_package("figrecipe", timeout=300). This is fragile — a future write-audit-test regeneration reverts it.
Requested durable fix (either)
- Bump
write-audit-test's emitted default timeout (e.g. 300s), or
- Make
audit_all_for_package read the timeout from .scitex/dev/config.yaml (e.g. audit.timeout) so packages can set it without hand-editing a generated file.
Optional (perf)
audit-all at ~55s standalone / >120s under load is a growing cost — if 2.30.x figure-lint/FM rules added weight, worth a profiling pass. (Same theme as the testmon bottleneck.)
Filed per the audit output's own escalation footer. Reported by the figrecipe agent while shipping 0.29.10.
Problem
The audit conformance test generated by
scitex-dev ecosystem write-audit-testcallsscitex_dev.testing.audit_all_for_package(pkg)with the defaulttimeout=120.0. In figrecipe's pytest-matrix CI (apptainer SIF, coverage instrumentation + parallel load),scitex-dev ecosystem audit-all figrecipedeterministically exceeds 120s and raisessubprocess.TimeoutExpired, failing the matrix on all 3 pythons (2544 other tests pass).audit-allruns clean in ~55s.Immediate workaround (in figrecipe)
Hand-edited the generated test to
audit_all_for_package("figrecipe", timeout=300). This is fragile — a futurewrite-audit-testregeneration reverts it.Requested durable fix (either)
write-audit-test's emitted default timeout (e.g. 300s), oraudit_all_for_packageread the timeout from.scitex/dev/config.yaml(e.g.audit.timeout) so packages can set it without hand-editing a generated file.Optional (perf)
audit-allat ~55s standalone / >120s under load is a growing cost — if 2.30.x figure-lint/FM rules added weight, worth a profiling pass. (Same theme as the testmon bottleneck.)Filed per the audit output's own escalation footer. Reported by the figrecipe agent while shipping 0.29.10.