Using the Standardized Letters of Recommendation in Selection Results From a Multidimensional Rasch Model

In an effort to standardize academic application procedures, the authors developed the Standardized Letters of Recommendation (SLR) to capture important cognitive and noncognitive qualities of graduate school candidates. The SLR, which consists of seven scales, is applied to an intern-selection scenario. Both professor ratings (n = 414) during the application process and mentor ratings of the selected students (n = 51) are collected using the SLR. A multidimensional Rasch investigation suggests that the SLR displays satisfactory internal consistency, model fit, and item fit. The two cognitive scales, knowledge and analytical skills, are found to be the best predictors for intern selection. The professor ratings are systematically higher than the mentor ratings. Possible reasons for the rating discrepancies are discussed. Also, implications for how the SLR can be used and improved in other selection situations are suggested