An irreducible stochastic matrix with rational entries has a stationary distribution given by a vector of rational numbers. We give an upper bound on the lowest common denominator of the entries of this vector. Bounds of this kind are used to study the complexity of algorithms for solving stochastic mean payoff games. They are usually derived using the Hadamard inequality, but this leads to suboptimal results. We replace the Hadamard inequality with the Markov chain tree formula in order to obtain optimal bounds. We also adapt our approach to obtain bounds on the absorption probabilities of finite Markov chains and on the gains and bias vectors of Markov chains with rewards
International audienceWe prove new iterative algorithms to provide component-wise bounds of the stea...
We develop explicit, general bounds for the probability that the normalized partial sums of a functi...
We study the fraction of time that a Markov chain spends in a given subset of states. We give an exp...
An irreducible stochastic matrix with rational entries has a stationary distribution given by a vect...
An irreducible stochastic matrix with rational entries has a stationary distribution given by a vect...
An irreducible stochastic matrix with rational entries has a stationary distribution given by a vect...
In this dissertation we study concentration properties of Markov chains,and sequential decision maki...
In this dissertation we study concentration properties of Markov chains,and sequential decision maki...
AbstractThis paper is devoted to perturbation analysis of denumerable Markov chains. Bounds are prov...
Performance evaluation of complex systems is a critical issue and bounds computation provides confid...
We develop explicit, general bounds for the probability that the empirical sample averages of a func...
Summary. Bounds on convergence rates for Markov chains are a very widely-studied topic, motivated la...
AbstractThe purpose of this paper is to review and compare the existing perturbation bounds for the ...
AbstractIn a situation where the unique stationary distribution vector of an infinite irreducible po...
International audienceWe prove new iterative algorithms to provide component-wise bounds of the stea...
International audienceWe prove new iterative algorithms to provide component-wise bounds of the stea...
We develop explicit, general bounds for the probability that the normalized partial sums of a functi...
We study the fraction of time that a Markov chain spends in a given subset of states. We give an exp...
An irreducible stochastic matrix with rational entries has a stationary distribution given by a vect...
An irreducible stochastic matrix with rational entries has a stationary distribution given by a vect...
An irreducible stochastic matrix with rational entries has a stationary distribution given by a vect...
In this dissertation we study concentration properties of Markov chains,and sequential decision maki...
In this dissertation we study concentration properties of Markov chains,and sequential decision maki...
AbstractThis paper is devoted to perturbation analysis of denumerable Markov chains. Bounds are prov...
Performance evaluation of complex systems is a critical issue and bounds computation provides confid...
We develop explicit, general bounds for the probability that the empirical sample averages of a func...
Summary. Bounds on convergence rates for Markov chains are a very widely-studied topic, motivated la...
AbstractThe purpose of this paper is to review and compare the existing perturbation bounds for the ...
AbstractIn a situation where the unique stationary distribution vector of an infinite irreducible po...
International audienceWe prove new iterative algorithms to provide component-wise bounds of the stea...
International audienceWe prove new iterative algorithms to provide component-wise bounds of the stea...
We develop explicit, general bounds for the probability that the normalized partial sums of a functi...
We study the fraction of time that a Markov chain spends in a given subset of states. We give an exp...