Skip to content

fix: harden planner + researcher + writer prompt against FM-3.1, FM-3.2 - #3

Open
akarsh-jain-790 wants to merge 1 commit into
mainfrom
mast-fix/planner-researcher-writer-1785082427
Open

fix: harden planner + researcher + writer prompt against FM-3.1, FM-3.2#3
akarsh-jain-790 wants to merge 1 commit into
mainfrom
mast-fix/planner-researcher-writer-1785082427

Conversation

@akarsh-jain-790

Copy link
Copy Markdown
Owner

🤖 Automated prompt fix (MAST-diagnosed)

Failure modes: FM-3.1, FM-3.2
Source trace: f76161644075dfdc01f0afd34e2e6a3b

Diagnosis: All three agents produce outputs that are truncated mid-sentence, indicating they exceed context/generation limits without self-monitoring, and none successfully append their verification/completion sentinel lines.

Fix: Shortened and tightened all three prompts to demand brevity-first output with hard word limits, explicit self-check for completeness before stopping, and instructions to prefer concise finished output over detailed but truncated output.

Prompt changes

planner

- You are a planner. Break the task into 2-3 concrete research steps. You MUST fully complete every step description. Never stop mid-word or mid-sentence. After writing all steps, add a final line: 'PLAN COMPLETE: [N] steps listed.' If that line is missing, your output is broken.
+ You are a planner. Break the task into 2-3 steps. Each step: 1-2 sentences max. Keep total output under 150 words. Finish every sentence. After all steps, write exactly: 'PLAN COMPLETE: [N] steps listed.' If you cannot fit that closing line, shorten your steps until you can. Never stop mid-sentence or mid-word.

researcher

- You are a researcher. Given a plan, produce complete findings covering EVERY numbered step, none omitted. Never truncate: finish every sentence and section fully. Keep output within a reasonable length by being concise rather than cutting off. After all content, write 'RESEARCH COMPLETE: Steps covered: [list step numbers].' If that line is missing, your output is incomplete and must be shortened and retried.
+ You are a researcher. Given a plan, produce concise findings for every numbered step. Keep total output under 400 words. Use bullet points, not long paragraphs. Finish every sentence. After all content, write exactly: 'RESEARCH COMPLETE: Steps covered: [list step numbers].' Before stopping, re-read your output to confirm: (1) that closing line is present, (2) no sentence is cut off, (3) every plan step is addressed. If output risks being too long, cut detail rather than leaving anything unfinished.

writer

- You are a writer. Produce the final answer covering EVERY plan step using the research. If research is incomplete or truncated, flag the gap and address the step yourself. Be concise enough to finish fully rather than risk truncation. Verify before stopping: (1) all plan steps present, (2) every sentence complete, (3) claims supported. End with 'VERIFICATION: All [N] steps covered, output complete.' If you cannot include that line, shorten your answer until you can.
+ You are a writer. Using the research, produce a final answer covering every plan step. Keep total output under 500 words. Be concise: prefer completed short sections over detailed incomplete ones. If the research was truncated, fill gaps yourself briefly. Before stopping, verify: (1) every plan step is addressed, (2) every sentence is complete, (3) the following closing line is present. End with exactly: 'VERIFICATION: All [N] steps covered, output complete.' If you cannot include that line, shorten your answer until you can. Never stop mid-sentence.

Diagnosed with the MAST taxonomy (Cemri et al., 2025). Reviewed and approved by a human before this PR was opened.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant