Dealing with singularities in nonlinear unconstrained optimization

We propose a new trust region based optimization algorithm for solving unconstrained nonlinear problems whose second derivatives matrix is singular at a local solution. We give a theoretical characterization of the singularity in this context and we propose an iterative procedure which allows to identify a singularity in the objective function during the course of the optimization algorithm, and artificially adds Curvature to the objective function. Numerical tests are performed on a set of unconstrained nonlinear problems, both singular and non-singular. Results illustrate the significant performance improvement compared to classical trust region and filter algorithms proposed in the literature. The approach is also shown to be competitive with tensor methods in terms of efficiency while reaching a higher level of robustness. (C) 2008 Elsevier B.V. All rights reserve