Do We Need Linguistics When We Have Statistics? A

each feature's positive or negative contribution to We present a comparative analysis of the performance of the overall performance. By matching cases where a statistics-based system for the formation of semantic groups all system parameters are the same except for one feature, we assess the statistical significance of the of adjectives when various sources of linguistic knowledge differences found. Also, a statistical model of the are introduced. We identify four different types of shallow system's performance in terms of the active fea- linguistic knowledge that are applicable to this system, and tures for each run offers a view of the contribu- we quantify the performance gained by incorporating each tions of features from a different angle, contrasting such knowledge module. We perform experiments for dif- the significance of linguistic features (or other ferent corpus sizes and different inputs (sets of adjectives to modeled system parameters) against each other