Evaluation of Teacher Performance; Summative

What users of student ratings of instruction know about ratings and what they need to know to make valid and reliable use of ratings data were studied. An item bank of 153 multiple-choice items was developed from sources of information about student ratings. The full item bank had five subsets: (1) knowledge of ratings concepts; (2) knowledge of quantitative issues for interpreting/applying ratings; (3) simulated practice exercises; (4) attitudes toward ratings issues; and (5) demographic variables associated with rating users. Items were validated by a panel of 24 experts to develop the shorter questionnaires mailed to faculty at three institutions and members of a professional group for a total of 779 respondents. Participation was 15 % for one institution and 20% for each of the other groups, except that the participation of the 23 experts in the field of ratings use was 100%. The magnitude of th