Monte Carlo Simulation of Markov Chain Steady-state Distribution

The most widely used mathematical tools to model the behavior of the fault-tolerant computer systems are regenerative Markov processes [1], [2], [10]. Many stationary performance measures of such systems can be written in an explicit form of the stationary distribution of a Markov process. On