Skip to content

fix: remove introspection framework#51

Merged
MichielDean merged 8 commits into
mainfrom
fix/remove-introspection
Jun 2, 2026
Merged

fix: remove introspection framework#51
MichielDean merged 8 commits into
mainfrom
fix/remove-introspection

Conversation

@MichielDean
Copy link
Copy Markdown
Owner

Summary

  • Remove the entire introspection/self_assessment system from LLMem
  • Deleted internal/introspect/ and internal/skillpatch/ packages (1,654 lines)
  • Removed introspect, learn, track-review CLI commands
  • Removed self_assessment memory type from store, retriever, migrations
  • Stripped dream REM behavioral insight generation (REM phase now produces themes only)
  • Removed SkillPatchDreamHook, proposed-changes.md support, skill patch validation
  • Cleaned all documentation, skills, and plugin references

Why

The introspection loop never closed: patterns were detected but never changed behavior. Without calibration data and a promotion pipeline, the system was sophisticated self-documentation, not self-improvement. The compounding loop was broken at the critical joint: detected patterns → changed behavior.

Changes

Deleted packages:

  • internal/introspect/ (387 + 660 test = 1,047 lines)
  • internal/skillpatch/ (410 + 567 test = 977 lines)

Deleted skills:

  • skills/introspection/SKILL.md, skills/introspection-review-tracker/SKILL.md
  • plugins/agent/skills/introspection/SKILL.md, plugins/agent/skills/introspection-review-tracker/SKILL.md

Simplified:

  • Dream REM phase: now produces type-count themes + word-cluster themes + total/active counts only
  • Removed: BehavioralInsight struct, extractBehavioralInsights, buildBehavioralInsightPrompt, validatePatches, Ollama client wiring in dream
  • Config: removed behavioral_threshold, behavioral_lookback_days, skill_patch_threshold, proposed_changes_path, model, model_timeout, call_model_timeout

Net change: 37 files, +219 −5,477 lines (5,258 net reduction)

Remove the entire introspection/self_assessment system:
- Deleted internal/introspect/ and internal/skillpatch/ packages
- Removed introspect, learn, track-review CLI commands
- Removed self_assessment memory type from store, retriever, migrations
- Stripped dream REM behavioral insight generation (themes only now)
- Removed SkillPatchDreamHook, ReviewOutcomeTracker, TestOutcomeTracker
- Removed proposed-changes.md support, skill patch validation
- Cleaned all documentation, skills, and plugin references

The introspection loop never closed: patterns were detected but never
changed behavior. Without calibration data and a promotion pipeline,
the system was sophisticated self-documentation, not self-improvement.

This comment was marked as resolved.

- hooks.json: replace stale llmem search proposed with llmem context --session-id start
- SKILL.md: 'Copies 2 skill directories' → 'Copies all skill directories'
- README.md: 'four skills' → 'two skills', '4 skill directories' → 'all skill directories',
  '8 standard types' → '7 standard types', update session start description
- docs/API.md: add conversation (0.7) to DefaultTypePriority example and table,
  add REVIEW_PASSED to ErrorTaxonomy docs, fix '8 standard types' → '7 standard types',
  migration 003 doc
- docs/INSTALLATION.md: '4 skill directories' → 'all skill directories',
  '8 standard types' → '7 standard types'
- docs/INTEGRATIONS.md: 'llmem stats + search' → 'llmem stats + llmem context',
  'Four skills' → 'Two skills', Claude Code hook description
- internal/store/models.go: '8 default/standard types' → '7'
- skills/llmem-setup/SKILL.md: update architecture diagram for session start command,
  update SessionStart hook description

This comment was marked as resolved.

…, fix doc drift

- hooks.json: remove SessionEnd hook (llmem hook doesn't exist), replace
  llmem context with llmem search for SessionStart and PreCompact
- opencode/llmem.js: replace llmem context with llmem search for
  session.created, remove session.idle handler (llmem hook doesn't exist)
- docs/RERANKING.md: add conversation:0.7 to type priority list
- docs/API.md: add OllamaClient field to ExtractionConfig table
- internal/ollama/ollama.go: remove dream from package comment
- docs/INTEGRATIONS.md: use llmem search in descriptions (not llmem context)
- skills/llmem-setup/SKILL.md: use llmem search in descriptions
- README.md: update session start description
- test.js: remove SessionEnd assertion (hook removed)

This comment was marked as resolved.

…I commands

- docs/CLI.md: remove context and hook command documentation
- docs/CONFIGURATION.md: replace llmem context/hook with llmem search
- docs/INTEGRATIONS.md: remove SessionEnd and session.idle/ending rows,
  update architecture diagram, remove llmem-hook from custom tools
- skills/llmem/SKILL.md: remove context/hook command references and
  important notes about session hooks
- skills/llmem-setup/SKILL.md: remove session.idle/ending from diagram
- plugins/agent/skills/llmem/SKILL.md: same
- plugins/agent/skills/llmem-setup/SKILL.md: remove context/hook refs,
  update verification commands

The llmem context and llmem hook commands were removed from the Go CLI
in commit ab30ec3. All references are now replaced with llmem search.

This comment was marked as resolved.

…mmands

- README.md: remove session hooks from Go capabilities, doc links,
  and test descriptions; remove idle/end extraction from plugin section
- docs/API.md: remove entire internal/session Go API section
- docs/DREAM.md: remove internal/session Go example
- docs/INSTALLATION.md: remove session hooks from Go binary description
- docs/INTEGRATIONS.md: remove idle/end extraction from intro,
  remove llmem-hook from custom tools, update tool count to five
- plugins/opencode/llmem.js: update comment from 'introspect' to 'consolidate'
- skills/llmem-setup/SKILL.md: remove llmem-hook from custom tools diagram,
  update description of plugin capabilities

This comment was marked as resolved.

- Remove .opencode/tools/llmem-hook.ts (calls nonexistent llmem hook command)
- Remove dead splitLines/TestSplitLines/TestParseKeyValue from taxonomy_test.go
  (tests local parsing helpers that were removed from production code)
- Remove unused sessionId variable from opencode plugin session.created handler
- Update test.js expected tools list (5 tools, not 6)

This comment was marked as resolved.

… tool

- docs/API.md: migration 003 registers types in memory_types table, not via CHECK constraint
- .opencode/tools/llmem-add.ts: remove self_assessment from type list
@MichielDean MichielDean merged commit d73e4b1 into main Jun 2, 2026
2 checks passed
@MichielDean MichielDean deleted the fix/remove-introspection branch June 2, 2026 00:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants