Robust linear regression

Regression analysis is one of the most extensively used statistical tools applied across different fields of science, with linear regression being its most well-known method. How- ever, the traditional procedure to obtain the linear model estimates, the least squares approach, is highly sensitive to even slight departures from the assumed modelling frame- work. This is especially pronounced when atypical values occur in the observed data. This lack of stability of the least squares approach is a serious problem in applications. Thus, the focus of this thesis lies in assessing the available robust alternatives to least squares estimation, which are not so easily affected by any outlying values. First, we introduce the linear regression model theory and derive the least squares method. Then, we char- acterise different types of unusual observations and outline some fundamental robustness measures. Next, we define and examine the robust alternatives to the classical estimation in the linear regression models. Finally, we conduct a comprehensive simulation study comparing the performance of robust methods under different scenarios.