Developing an English Proficiency Test for Kurume University : Listening Comprehension

This study attempts to develop a listening comprehesion test for assessing the language proficiency levels of students of Kurume University. An overview of the previous research including reliability and validity on listening comprehension is discussed and a comparison of various tests available on the market is made. Three kinds of English listening tests, the SLEP test, STANDARD test, and BASIC test were given to 142 students of Kurume University and the results were analized. There are strong correlations between the SLEP test and the BASIC test and between the SLEP test and the STANDARD test, suggesting they are reliable tests. In order to see the predictive validity, the correlations between the BASIC/STANDARD tests and the final grades of the individual student were examined. There are moderate correlations between the BASIC test and the final grades of the students, but almost no correlations were found between the STANDARD test and their final grades. Concerning the level of students, however, the upper 28% of the students in the STANDARD and BASIC tests indicated higher correlations with their final grades. For the lower 28% of the students in the BASIC and STANDARD tests, there was no correlation between the tests and their final grades. This suggests that those students who obtained lower scores in these tests are not necessarily the poorer students in the class. It is considered that if these students are placed in a class appropriate to their levels and needs, their listening skills will possibly be better developed. The average percentages of correct responses in the SLEP, STANDARD and BASIC tests did not show any significant differnces, but the item analysis in the individual test revealed noticeable results. A very few items in the STANDARD and SLEP tests met the criteria of item discriminability (ID) which requires an index of higher than .67. The BASIC TEST, on the other hand, showed the highest rate of items with reliable item discrimination. It can be said that the STANDARD and SLEP tests might be less appropriate to discriminate between higher and lower levels of our students. The BASIC test was, among of those we looked at, considered to be the most appropriate placement test available on the market. Finally, some suggestions as well as sample test questions on the most appropriate listening test for Kurume University students are provided in terms of form, type, and contents.departmental bulletin pape