Chatbot prompt: four rules from log triage#451
Draft
bryceerobertson wants to merge 4 commits into
Draft
Conversation
A conversation log (10 Jul, Bologna) showed the bot inventing "since you read French" to justify recommending a French-language Discord server to a user in Italy writing in English. Nothing in its context supported the claim. Extend the community language rule to forbid asserting language abilities the user hasn't stated or shown, and bump PROMPT_VERSION. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
… user's frame
Two more prompt rules from log triage, joining the invented-language fix:
- Featured results: explain the featured flag (curated top picks, sorted
first on purpose) and forbid cherry-picking via invented sub-criteria.
A funding conversation (12 Jul, Giza) skipped both featured funders at
positions 1-2 for better-known names at 3, 5, and 11 under a made-up
"rolling basis" frame.
- Frame-of-reference echo: relative listing claims ("no relocation
needed", "local") are written for the listing's own audience and must
be re-checked against the user's context. A conversation (12 Jul,
Orlando) told a Florida user an Asia/Australia-NZ program needs no
relocation.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
bryceerobertson
changed the title
…d end The prompt claimed "there's nothing to submit" for jobs, so the bot told a user asking how to post an opportunity that job submission is impossible. 80,000 Hours accepts role proposals at jobs.80000hours.org/submit-role, and AI safety roles it accepts flow through to the site's job board. The jobs exception now routes job POSTERS to that form (and keeps job SEEKERS pointed at the board), and the form joins the sanctioned off-site links. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
bryceerobertson
changed the title
…bition Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Four prompt fixes, each traced from a logged conversation and written into the prompt with its concrete failure example:
featured: truemeans (curated top picks, sorted first on purpose) and names invented sub-criteria as cherry-picking.Bumps PROMPT_VERSION to 2026-07-13-01 so log triage can tell old behavior from new.
🤖 Generated with Claude Code