How good was the test set up? From Rasch Analysis Perspective

Abstract This research analysed the validity and reliability of given questions in the Linear Algebra course at Universiti Kebangsaan Malaysia (UKM). Through Rasch analysis, the difficulty of the questions with respect to students' ability level was assessed. The 20 questions covering such topics as hyperbolic function, eigenvalue and eigenvector, vectors, etc were administrated to 240 first-year faculty of engineering and built environment students. The dichotomous Rasch model using 0 (if student guessed wrong) and 1 (if student guessed right) scoring of item response data was applied. The analysis distinguished item hierarchy, items gaps, unidimensionality, fit-statistic, person reliability and separation statistics. The report provides interesting information that may be used to improve the validity and reliability of items