On-line almost-sure parameter estimation for partially observed discrete-time linear systems with known noise characteristics

In this paper we discuss parameter estimators for fully and partially observed discrete-time linear stochastic systems (in state-space form) with known noise characteristics. We propose finite-dimensional parameter estimators that are based on estimates of summed functions of the state, rather than of the states themselves. We limit our investigation to estimation of the state transition matrix and the observation matrix. We establish almost-sure convergence results for our proposed parameter estimators using standard martingale convergence results, the Kronecker lemma and an ordinary differential equation approach. We also provide simulation studies which illustrate the performance of these estimators. Copyright © 2002 John Wiley & Sons, Ltd