Markov processes are interesting stochastic proceses with a wide range of applications. In this report we study Markov processes with two time scales where the difference between the time speed of the scales is asymptotically large. In such a situation the behaviour of the process can be estimated by substituting the "faster" process by its limiting process. We will introduce Markov processes and study in particular Markov processes with two time scales in the limit where one of the time scales is much faster than the other. Later we will prove statements about the behaviour for a general situation. Finally, two interesting applications of this scenario will be discussed.Electrical Engineering, Mathematics and Computer ScienceDelft Institut...
This work is concerned with least-mean-squares (LMS) algorithms in continuous time for tracking a ti...
Abstract. An approximation of Markov type queueing models with fast Markov switches by Markov models...
AbstractModels for Markov processes indexed by a branching process are presented. The new class of m...
We present for the first time an asymptotic convergence analysis of two time-scale stochastic approx...
In this dissertation we investigate asymptotic properties of Markov modulated random processes havin...
We study the asymptotic behaviour of a sequence of Piecewise Constant Markov Processes (in short PDM...
The aim of the paper is to understand how the inclusion of more and more time scales into a stochast...
AbstractWe consider a general class of piecewise-deterministic Markov processes with multiple time-s...
Asymptotic properties of two time-scale stochastic approximation algorithms with constant step sizes...
A dynamic flow-shop is considered consisting of one slow and one fast machine. Production capacities...
In this paper, we deal with a two-queue polling system attended by a single server. The server visit...
Beginning with independent Markov processes, multiparameter Markov vector processes are constructed....
International audienceA Markov process is a stochastic process that satisfies the Markov property, i...
Simultaneous changes of time scales of the components of a vector Markov process are defined and dev...
For Gauss-Markov processes the asymptotic behaviors of the first passage time probability density fu...
This work is concerned with least-mean-squares (LMS) algorithms in continuous time for tracking a ti...
Abstract. An approximation of Markov type queueing models with fast Markov switches by Markov models...
AbstractModels for Markov processes indexed by a branching process are presented. The new class of m...
We present for the first time an asymptotic convergence analysis of two time-scale stochastic approx...
In this dissertation we investigate asymptotic properties of Markov modulated random processes havin...
We study the asymptotic behaviour of a sequence of Piecewise Constant Markov Processes (in short PDM...
The aim of the paper is to understand how the inclusion of more and more time scales into a stochast...
AbstractWe consider a general class of piecewise-deterministic Markov processes with multiple time-s...
Asymptotic properties of two time-scale stochastic approximation algorithms with constant step sizes...
A dynamic flow-shop is considered consisting of one slow and one fast machine. Production capacities...
In this paper, we deal with a two-queue polling system attended by a single server. The server visit...
Beginning with independent Markov processes, multiparameter Markov vector processes are constructed....
International audienceA Markov process is a stochastic process that satisfies the Markov property, i...
Simultaneous changes of time scales of the components of a vector Markov process are defined and dev...
For Gauss-Markov processes the asymptotic behaviors of the first passage time probability density fu...
This work is concerned with least-mean-squares (LMS) algorithms in continuous time for tracking a ti...
Abstract. An approximation of Markov type queueing models with fast Markov switches by Markov models...
AbstractModels for Markov processes indexed by a branching process are presented. The new class of m...