In this paper we present the concept of description of random processes in complex systems with discrete time. It involves the description of kinetics of discrete processes by means of the chain of finite-difference non-Markov equations for time correlation functions (TCFs). We have introduced the dynamic (time dependent) information Shannon entropy Si(t) where i=0,1,2,3, . . . , as an information measure of stochastic dynamics of time correlation (i=0) and time memory (i=1,2,3, . . . ). The set of functions Si(t) constitute the quantitative measure of time correlation disorder (i=0) and time memory disorder (i=1,2,3, . . . ) in complex system. The theory developed started from the careful analysis of time correlation involving dynamics of ...