Trust Region Algorithms For Constrained Optimization

We review the main techniques used in trust region algorithms for nonlinear constrained optimization. 1. Trust Region Idea Constrained optimization is to minimize a function subject to finitely many algebraic equation and inequality conditions. It has the following form min x2! n f(x) (1.1) subject to c i (x) = 0; i = 1; 2; : : : ; m e ; (1.2) c i (x) 0; i = m e + 1; : : : ; m; (1.3) where f(x) and c i (x) (i = 1; : : : ; m) are real functions defined in ! n , and m m e are two non-negative integers. Numerical methods for nonlinear optimization problems can be grouped as two types. One are line search methods and the other are trust region algorithms. Line search algorithms at each iteration use a direction to carry a line search. The direction is called the search direction, which is normally computed by solving a subproblem that approximates the original problem near the current iterate. A line search means to search for a new point along the search direction. For example, ..