Search results

Research published (90.2% mean test pass rate, 53% of repos fully solved, 2.28× SOTA)

Status: Open.

#11 In multimodal-art-projection/NL2RepoBench;

· professorpalmer opened on Jun 17, 2026

Request: Could you provide official reference solutions for benchmark tasks

Status: Open.

#10 In multimodal-art-projection/NL2RepoBench;

· Yaoming95 opened on Jun 15, 2026

Overall Score and Pass@1 Methodology

Status: Open.

#8 In multimodal-art-projection/NL2RepoBench;

· YMRTZ opened on May 19, 2026

Test case number inconsistent with main repos

Status: Open.

#7 In multimodal-art-projection/NL2RepoBench;

· xeophon opened on Apr 22, 2026

GLM-5.1 not found

Status: Open.

#6 In multimodal-art-projection/NL2RepoBench;

· jimwan2026 opened on Apr 18, 2026

Hard任务的具体名字能否提供？

Status: Open.

#5 In multimodal-art-projection/NL2RepoBench;

· wangjvjie opened on Mar 14, 2026

Availability of task metadata (LOC and categories)

Status: Open.

#3 In multimodal-art-projection/NL2RepoBench;

· ZJK-code opened on Jan 27, 2026

Post-processing fails due to missing base image

Status: Open.

#2 In multimodal-art-projection/NL2RepoBench;

· YuyaoGe opened on Dec 23, 2025

Release NL2Repo-Bench dataset on Hugging Face

Status: Open.

#1 In multimodal-art-projection/NL2RepoBench;

· NielsRogge opened on Dec 21, 2025