Model Problems in Numerical Stability Theory for Initial Value Problems

In the past numerical stability theory for initial value problems in ordinary differential equations has been dominated by the study of problems with simple dynamics; this has been motivated by the need to study error propagation mechanisms in stiff problems, a question modeled effectively by contractive linear or nonlinear problems. While this has resulted in a coherent and self-contained body of knowledge, it has never been entirely clear to what extent this theory is relevant for problems exhibiting more complicated dynamics. Recently there have been a number of studies of numerical stability for wider classes of problems admitting more complicated dynamics. This on-going work is unified and, in particular, striking similarities between this new developing stability theory and the classical linear and nonlinear stability theories are emphasized. The classical theories of A, B and algebraic stability for Runge–Kutta methods are briefly reviewed; the dynamics of solutions within the classes of equations to which these theories apply—linear decay and contractive problems—are studied. Four other categories of equations—gradient, dissipative, conservative and Hamiltonian systems—are considered. Relationships and differences between the possible dynamics in each category, which range from multiple competing equilibria to chaotic solutions, are highlighted. Runge-Kutta schemes that preserve the dynamical structure of the underlying problem are sought, and indications of a strong relationship between the developing stability theory for these new categories and the classical existing stability theory for the older problems are given. Algebraic stability, in particular, is seen to play a central role. It should be emphasized that in all cases the class of methods for which a coherent and complete numerical stability theory exists, given a structural assumption on the initial value problem, is often considerably smaller than the class of methods found to be effective in practice. Nonetheless it is arguable that it is valuable to develop such stability theories to provide a firm theoretical framework in which to interpret existing methods and to formulate goals in the construction of new methods. Furthermore, there are indications that the theory of algebraic stability may sometimes be useful in the analysis of error control codes which are not stable in a fixed step implementation; this work is described