SYNC: add rs_inventory_q.md from lecture-python.myst#20
Merged
Conversation
Mirrors lectures/rs_inventory_q.md from QuantEcon/lecture-python.myst at upstream commit 78030a3a2 (latest commit touching this file, via PR QuantEcon/lecture-python.myst#859). File contains 10 {doc} references to inventory_q (added in #19) and no {cite} keys. Not yet wired into _toc.yml; activated by the TOC PR for #4. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
There was a problem hiding this comment.
Pull request overview
This PR adds a new lecture, rs_inventory_q.md, introducing a risk-sensitive variant of the inventory management model and showing how to solve it via value function iteration and a risk-sensitive adaptation of Q-learning (mirrored from lecture-python.myst).
Changes:
- Add a new MyST/Jupytext lecture file on risk-sensitive inventory control with a risk-sensitive Bellman operator (log-sum-exp) and greedy policy extraction.
- Implement and demonstrate a risk-sensitive Q-factor formulation and corresponding Q-learning update rule (argmin policy).
- Include plotting, simulation, and learning-trajectory visualization cells for comparing VFI vs Q-learning outcomes.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
lectures/rs_inventory_q.md, mirrored fromQuantEcon/lecture-python.mystat upstream commit 78030a3a2 (latest commit touching this file, via PR Add lectures on Kihlstrom's paper, Ross Recovery Theorem and update lectures in probability theory lecture-python.myst#859; originally introduced in Add risk-sensitive inventory management lecture lecture-python.myst#827).inventory_q.md(this file{doc}-references it 10 times)._toc.yml—only_build_toc_files: truekeeps it out of the build until the TOC PR lands.{cite}references; no intersphinx-prefix localizations needed.Follow-ups
lecture-python.mystmapping from 25 → 27 files.Test plan
{doc}references toinventory_qresolve against a real file inmain.🤖 Generated with Claude Code