So, i'm not sure:
- if this is the right place for this
- whether it's a real issue (looks suspicious to me though)
- whether this is already known (i didn't see another issue describing it anyway)
... but i think the document at https://arxiv.org/pdf/2201.03904 describes the transition model incorrectly on page 5 under "The POMDP Generative Model":
I suspected when i saw it that it second "s sub tau" should be "s sub tau - 1". This was confirmed on page 7 though where it was written how i expected:
I'm a software dev, not an academic, so naturally i'm raising this in github :|, and only the hope that it is helpful.
The document otherwise is very interesting and helpful, and i appreciate the obvious effort that went into its writing.
So, i'm not sure:
... but i think the document at https://arxiv.org/pdf/2201.03904 describes the transition model incorrectly on page 5 under "The POMDP Generative Model":
I suspected when i saw it that it second "s sub tau" should be "s sub tau - 1". This was confirmed on page 7 though where it was written how i expected:
I'm a software dev, not an academic, so naturally i'm raising this in github :|, and only the hope that it is helpful.
The document otherwise is very interesting and helpful, and i appreciate the obvious effort that went into its writing.