Abstract
It is shown that the communicating property of Markov Decision Processes (MDPs) is equivalent to satisfaction of sets of linear equations. A mapping between the 'multichain' and 'unichain' linear programs for undiscounted MDPs is developed by applying this equivalence. The mapping is used to prove that the simpler linear program solves communicating MDPs.
Original language | English (US) |
---|---|
Pages (from-to) | 303-307 |
Number of pages | 5 |
Journal | Operations Research Letters |
Volume | 7 |
Issue number | 6 |
DOIs | |
State | Published - Dec 1988 |
Keywords
- irreducible Markov chains
- linear programming
ASJC Scopus subject areas
- Software
- Management Science and Operations Research
- Industrial and Manufacturing Engineering
- Applied Mathematics