On the Regressand Noise Problem: Model Robustness and Synergy With Regression-Adapted Noise Filters

The authors thank the anonymous reviewers for the time spent on this research work, as well as all their interesting corrections and suggestions, which provided important and valuable feedback to identify essential issues and helped to improve the quality of the manuscript.This research focuses on analyzing the robustness of different regression paradigms under regressand noise, which has not been examined in depth in the specialized literature. Furthermore, their synergy with fourteen noise preprocessing techniques adapted from the field of classification, known as noise filters, is studied. In order to do this, several noise levels are injected into the output variable of 20 real-world datasets. They are used to evaluate the performance of each regression algorithm with and without the employment of noise filters. The results obtained allow building a robustness ranking of the regression methods to regressand noise. This provides interesting findings, such as some learning paradigms change their well-know behavior with noise in classification problems when they are applied to regression data. On the other hand, the usage of noise filters improves the performance of regression methods, showing different synergies depending on the regression paradigm and filter employed