Least Squares Alternatives

In the present thesis we deal with the linear regression models based on least squares. These methods are discussed in two groups. The first one focuses on three primary aproaches devided by occurrence of errors in variables. The traditional approach penalizes only the misfit in the de- pendent variable part and is called the ordinary least squares (OLS). An opposite case to the OLS is represented by the data least squares (DLS), which allow corrections only in the explanatory variables. Consecutively, we concentrate ourselves on the total least squares approach (TLS) mi- nimizing the squares of errors in the values of both dependent and independent variables. Finally, we give attention to next group of methods whit high breakdown point, which deal with signifi- cance of the individual observations (least weighted squares) and elimination of outlying obser- vations (least trimmed squares). The main purpose of this work is to describe and compare these models, their assumptions, characteristics, properties of estimates and show them on real data.