Skip to content

Challenge correctness is derived from fragile output text #194

Description

@ionfwsrijan

Problem

Coding challenge submissions are marked correct based on output text containing "Passed".

Evidence

Affected code:

  • backend/controllers/challenge.controller.js

The result logic checks output/error content rather than structured test execution results.

Impact

A malicious or buggy execution result can include the word "Passed" and be treated as correct even if tests failed. This compromises challenge integrity and leaderboards.

Expected fix

  • Return structured execution results from the judge/test runner
  • Require all test cases to pass explicitly
  • Store failed-case details separately
  • Add tests proving "Passed" in stdout alone does not mark a submission correct

Metadata

Metadata

Assignees

No one assigned

    Labels

    gssoc:approvedApproved for GirlScript Summer of Code

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions