Variable Selection in Linear Regression with Grouptructure via the Group Lasso and Mallows'' Cp

We consider the problem of selecting grouped variable in linear regression via the group Lasso and Mallows'' Cp, especially when the columns in the full design matrix are orthogonal. We address two questions. Since Mallows'' Cp is derived to be prediction optimal, how well the group Lasso coupled with Cp-criterion performs on selecting or dropping grouped variables? Since the group Lasso exploits additional group structure, will it perform better than Lasso on selecting the correct model? We propose that the behavior of the group Lasso coupled with Cp-criterion on selecting or dropping a grouped variable is like the detection of the grouped variable coming from χ2p or χ''2p. Moreover, we observe that the group Lasso coupled with Cp-criterion leads to a over-fitted regression model. The group structures do not always encourage us to select a better model when we compare that with Cp-Lasso.Abstract v Introduction 1 The group Lasso with Cp-criterion 3 Orthogonal design case 6 3.1 One-grouped variable 8 3.2 More on two-grouped variable 15 3.3 More on three-grouped variable 27 3.4 General case 36 Simulation studies 38 4.1 One-grouped variable 38 4.2 Two-grouped and three-grouped variable cases 39 Discussion 41 References 4