Skip to content

TOC: introduce "Markov Decision Processes" section#21

Open
mmcky wants to merge 1 commit into
mainfrom
toc-markov-decision-processes-section
Open

TOC: introduce "Markov Decision Processes" section#21
mmcky wants to merge 1 commit into
mainfrom
toc-markov-decision-processes-section

Conversation

@mmcky
Copy link
Copy Markdown
Contributor

@mmcky mmcky commented May 28, 2026

Summary

Implements the lecture reorder agreed in #4 and finalised in this comment thread:

This is the third (and final) PR for #4. PRs #19 and #20 added the two new files to the repo but kept them out of the build (only_build_toc_files: true); this PR activates them and closes the reorder.

Why this structure

discrete_dp is the MDP-theoretical foundation that the three Q-learning lectures build on, so grouping them together gives a coherent reading order and fixes the difficulty cliff that motivated #4 (per @jstac's note that discrete_dp was a lot more advanced than the introductory lectures that followed it).

Test plan

  • CI build succeeds (this is the first build with inventory_q / rs_inventory_q in the TOC).
  • Generated HTML shows the new section between Income Fluctuation Problems and LQ Control.
  • The 10 {doc} references to inventory_q inside rs_inventory_q.md resolve.
  • The {cite}\Sargent_Stachurski_2025`reference ininventory_q.md` resolves (entry added in SYNC: add inventory_q.md from lecture-python.myst #19).
  • No internal {doc} references break for discrete_dp or mccall_q after the move (verified locally — no cross-references in the repo depended on their old paths).

Follow-up

Update #7 to bump the lecture-python.myst mapping from 25 → 27 files.

Closes #4

🤖 Generated with Claude Code

Implements the lecture reorder agreed in #4:

- Removes discrete_dp from Introduction (Introduction now contains only short_path).
- Removes mccall_q from Job Search (now 8 lectures).
- Adds a new "Markov Decision Processes" section between Income Fluctuation Problems and LQ Control, containing discrete_dp, inventory_q, rs_inventory_q, mccall_q.

discrete_dp is the theoretical foundation (MDP setup) that the Q-learning lectures build on, so they sit together; this also fixes the difficulty curve in Introduction (per @jstac's note that discrete_dp was much more advanced than the lectures that followed). Files inventory_q.md and rs_inventory_q.md were added to the repo in #19 and #20 respectively but were not yet wired into the build (only_build_toc_files: true); this commit activates them.

Closes #4

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Copilot AI review requested due to automatic review settings May 28, 2026 07:29
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the Jupyter Book table of contents to implement the agreed lecture reordering by introducing a new “Markov Decision Processes” section and relocating existing lectures to match the intended learning progression.

Changes:

  • Remove discrete_dp from Introduction (leaving short_path as the sole lecture there).
  • Remove mccall_q from Job Search.
  • Add a new Markov Decision Processes part containing discrete_dp, inventory_q, rs_inventory_q, and mccall_q between Income Fluctuation Problems and LQ Control.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

TASK: reorder lectures

2 participants