Skip to content

Switch default scoring from weighted to copeland#110

Merged
that-github-user merged 1 commit into
mainfrom
issue-109-copeland-default
Mar 28, 2026
Merged

Switch default scoring from weighted to copeland#110
that-github-user merged 1 commit into
mainfrom
issue-109-copeland-default

Conversation

@that-github-user

Copy link
Copy Markdown
Owner

Summary

One-line change: default --scoring from weighted to copeland.

Evidence (docs/scoring-evaluation.md, 21 runs):

  • Copeland = Borda: 86% agreement (two independent methods converge)
  • Weighted disagrees with both ~40% (arbitrary weights)
  • Copeland is scale-independent and Condorcet-consistent

Change type

  • New feature

Related issue

Closes #109

How to test

thinktank run --help  # shows copeland as default
thinktank run "task" -n 3  # uses Copeland scoring
thinktank run "task" --scoring weighted  # old behavior still available

Breaking changes

  • Default scoring method changed. Use --scoring weighted for previous behavior.

🤖 Generated with Claude Code

Data-driven decision based on scoring evaluation (docs/scoring-evaluation.md):
- Copeland and Borda agree 86% (independent validation from social choice theory)
- Weighted disagrees with both ~40% (arbitrary point weights distort)
- Copeland is scale-independent and Condorcet-consistent

Closes #109

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@that-github-user that-github-user merged commit dad1863 into main Mar 28, 2026
4 checks passed
@that-github-user that-github-user deleted the issue-109-copeland-default branch March 28, 2026 23:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Switch default scoring method from weighted to copeland

1 participant