Conditions for existence of average and Blackwell optimal stationary policies in denumerable Markov decision processes

AbstractSufficiency conditions are given for the existence of stationary Blackwell optimal policies. These conditions concern only the one step transition probability matrices and their resolvents and therefore appear to be more natural than those recently introduced by Dekker and Hordijk. We use the same operator-theoretic approach and standard results about spectral theory of bounded linear operators