In this paper we present a systematic approach to the construction of bounds for the average costs in Markov chains with possibly infinitely many states. The technique used to prove the bounds is based on dynamic programming. Most performance characteristics of Markovian systems can be represented by the average costs for some appropriately chosen cost structure. Therefore, the approach can be used to generate bounds for relevant performance characteristics. The approach is demonstrated for the shortest queue model. It is shown how for this model several bounds for the mean waiting time can be constructed. We include numerical results to demonstrate the quality of these bound
Markov models are often used for performance modeling. However most models do not have closed form s...
This paper focuses on new measures of performance in single-server Markovian queueing system. These ...
International audienceIn many real-life queueing systems, the servers are often heterogeneous, namel...
In this paper we present a systematic approach to the construction of bounds for the average costs i...
In this paper we present a systematic approach for the construction of bounds for the average cost i...
A new bound is proposed relating the average cost sub-optimality of a myopic policy to its different...
When evaluating quantitative measures of complex systems using Markov models, a major drawback is th...
The value function for the average cost control of a class of partially observed Markov chains is de...
This paper presents a new method to compute bounds of performance parameters of Markov chains exhibi...
In many real-life queueing systems, the servers are often heterogeneous, namely they work at differe...
We introduce a new algorithm based on linear programming for optimization of average-cost Markov dec...
The long-run average cost control problem for discrete time Markov chains on a countable state space...
The purpose of this paper is two-fold. First, bounds on the rate of convergence of empirical measure...
Numerical methods for solving Markov chains are in general ine??cient if the state space of the chai...
In this paper, we present a numerical framework for constructing bounds on stationary performance me...
Markov models are often used for performance modeling. However most models do not have closed form s...
This paper focuses on new measures of performance in single-server Markovian queueing system. These ...
International audienceIn many real-life queueing systems, the servers are often heterogeneous, namel...
In this paper we present a systematic approach to the construction of bounds for the average costs i...
In this paper we present a systematic approach for the construction of bounds for the average cost i...
A new bound is proposed relating the average cost sub-optimality of a myopic policy to its different...
When evaluating quantitative measures of complex systems using Markov models, a major drawback is th...
The value function for the average cost control of a class of partially observed Markov chains is de...
This paper presents a new method to compute bounds of performance parameters of Markov chains exhibi...
In many real-life queueing systems, the servers are often heterogeneous, namely they work at differe...
We introduce a new algorithm based on linear programming for optimization of average-cost Markov dec...
The long-run average cost control problem for discrete time Markov chains on a countable state space...
The purpose of this paper is two-fold. First, bounds on the rate of convergence of empirical measure...
Numerical methods for solving Markov chains are in general ine??cient if the state space of the chai...
In this paper, we present a numerical framework for constructing bounds on stationary performance me...
Markov models are often used for performance modeling. However most models do not have closed form s...
This paper focuses on new measures of performance in single-server Markovian queueing system. These ...
International audienceIn many real-life queueing systems, the servers are often heterogeneous, namel...