Skip to content

[codex] add DQN debug learner#72

Merged
salim4n merged 1 commit into
mainfrom
feat/learning-dqn-debug-learner
May 29, 2026
Merged

[codex] add DQN debug learner#72
salim4n merged 1 commit into
mainfrom
feat/learning-dqn-debug-learner

Conversation

@salim4n
Copy link
Copy Markdown
Member

@salim4n salim4n commented May 29, 2026

Closes #51

What changed

  • Added a TypeScript DqnLearner with replay buffer, epsilon decay, target network and JSON neural checkpoint envelopes.
  • Added trainDqn(), DQN config/default exports and stable DQN metrics.
  • Enabled DQN checkpoint inference for discrete CLI environments.
  • Added CI smoke coverage proving GridWorld DQN inference improves over random.

Validation

  • bun run typecheck
  • bun test packages/learning/test/dqn.test.ts packages/learning/test/config-metrics.test.ts packages/learning/test/neural-adapter.test.ts packages/cli/test/cli.test.ts
  • bun run build:packages && bun scripts/ci-smoke.mjs
  • bun run ci

@salim4n salim4n marked this pull request as ready for review May 29, 2026 02:14
@salim4n salim4n merged commit e307910 into main May 29, 2026
1 check passed
@salim4n salim4n deleted the feat/learning-dqn-debug-learner branch May 29, 2026 02:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat(learning): DQN learner for discrete debug environments

1 participant