A View of What Can Happen When Behavioral Expectation Scales are Developed in One Setting and Used in Another

Pairs of supervisors in 2 large hospitals rated 24 groups of their subordinate nurses, using P. C. Smith and L. M. Kendall\u27s Behavioral Expectation Scale (BES) and a simpler, numerically anchored format. A counter-balanced research design was used to explore the differences in the operational effectiveness of the 2 formats. Results indicate that in terms of interrater reliability and confidence in ratings, the BES was slightly superior. However, when the simpler scale was used there was significantly less leniency effect and raters were better able to discriminate among different ratees in terms of performance. It is concluded that when a behavioral expectation scale is transplanted from one setting to another, the effectiveness of the scaled-expectations format may suffer because the raters do not participate in scale development and/or certain anchors are inappropriate for the new situation