From c3480b8a8fec462172024c7883fb60e3969afc38 Mon Sep 17 00:00:00 2001 From: Matt McKay Date: Thu, 28 May 2026 17:29:04 +1000 Subject: [PATCH] TOC: introduce "Markov Decision Processes" section Implements the lecture reorder agreed in #4: - Removes discrete_dp from Introduction (Introduction now contains only short_path). - Removes mccall_q from Job Search (now 8 lectures). - Adds a new "Markov Decision Processes" section between Income Fluctuation Problems and LQ Control, containing discrete_dp, inventory_q, rs_inventory_q, mccall_q. discrete_dp is the theoretical foundation (MDP setup) that the Q-learning lectures build on, so they sit together; this also fixes the difficulty curve in Introduction (per @jstac's note that discrete_dp was much more advanced than the lectures that followed). Files inventory_q.md and rs_inventory_q.md were added to the repo in #19 and #20 respectively but were not yet wired into the build (only_build_toc_files: true); this commit activates them. Closes #4 Co-Authored-By: Claude Opus 4.7 (1M context) --- lectures/_toc.yml | 9 +++++++-- 1 file changed, 7 insertions(+), 2 deletions(-) diff --git a/lectures/_toc.yml b/lectures/_toc.yml index 4e69e49..209e204 100644 --- a/lectures/_toc.yml +++ b/lectures/_toc.yml @@ -5,7 +5,6 @@ parts: numbered: true chapters: - file: short_path - - file: discrete_dp - caption: Job Search numbered: true chapters: @@ -17,7 +16,6 @@ parts: - file: career - file: jv - file: odu - - file: mccall_q - caption: Optimal Savings numbered: true chapters: @@ -35,6 +33,13 @@ parts: - file: ifp_egm - file: ifp_egm_transient_shocks - file: ifp_advanced +- caption: Markov Decision Processes + numbered: true + chapters: + - file: discrete_dp + - file: inventory_q + - file: rs_inventory_q + - file: mccall_q - caption: LQ Control numbered: true chapters: