Context
benchmarks/swefficiency does not appear to have a corresponding Harbor registry dataset/adapter yet. It has resource-sensitive Docker behavior and performance-oriented verification, so it should be ported deliberately with parity checks.
Proposed scope
- Create a Harbor adapter/dataset for SWEfficiency tasks.
- Preserve CPU/memory/resource assumptions and performance scoring semantics.
- Validate Oracle/reference behavior where available.
- Compare current OpenHands harness results against Harbor runs.
Acceptance criteria
- SWEfficiency tasks can be run through Harbor with appropriate resource controls.
- Performance/verifier parity is documented.
- The OpenHands wrapper can delegate SWEfficiency execution to Harbor.
Context
benchmarks/swefficiencydoes not appear to have a corresponding Harbor registry dataset/adapter yet. It has resource-sensitive Docker behavior and performance-oriented verification, so it should be ported deliberately with parity checks.Proposed scope
Acceptance criteria