Derivative Convergence for Iterative Equation Solvers

When nonlinear equation solvers are applied to parameter-dependent problems, their iterates can be interpreted as functions of these variable parameters. If they exist, the derivatives of these iterated functions can be recursively evaluated by the forward mode of automatic differentiation. Then one may ask whether and how fast these derivative values converge to the derivative of the implicit solution function, which may be needed for parameter identification, sensitivity studies, or design optimization. It is shown here that derivative convergence is achieved with an R-linear or possibly R-superlinear rate for a large class of memory-less contractions or secant updating methods. For a wider class of multi-step contractions, we obtain R-linear convergence of a simplified derivative updating scheme, which is more economical and can be easily generalized to second higher derivatives. We also formulate a constructive criterion for derivative convergence based on the implicit function the..