The Performance of computerized adaptive testing of Chinese listening comprehension – Using CEFR level A2 as an example

[[abstract]]Nowadays, paper-and-pencil-based testing is still the primary form of Chinese language proficiency testing today. Even though some online systems have been developed, they still lack adaptive function. The Common European Framework of Reference (CEFR) provides descriptions of language proficiency, guidelines on language learning, proficiency structure, and aspects of language communication. After long-term scientific research and broad discussions, CEFR does provide clear standards for learning a foreign language. If we can build a connection between CEFR and Chinese language proficiency testing system, the learners shall have a clear picture of their own Chinese ability level through the clear ability description of CEFR. The purposes of this study were as follows: 1.To establish a “CEFR-based, adaptive Chinese listening comprehension test system which enables not only the testees but also the administrators to use the system through the user-friendly administrator interface. 2.To simulate the process of the computerized adaptive test system with empirical data in order to evaluate the effects of the system. First of all, the test system was tested on 762 students from Philippine Chinese School; then, the item parameters were analyzed according to the test results. Lastly, the empirical data were used to simulate the process of the computerized adaptive test system. According to the analysis of the research results, it can be concluded that: 1.Successfully establishing Chinese listening comprehension test system allows testees to take tests and check test results immediately, as well as provides a back-end management platform for administrators to know the testees’ ability well. 2.According to the simulation research on different ability estimation methods, it is found that the expected a posteriori (EAP) estimation is better than the maximum likelihood estimation (MLE) and maximum a posteriori (MAP) estimation, as a whole, in the use of the Chinese reading comprehension test. Therefore, it is suggested that EAP be employed for the test. Keywords: Chinese language, CEFR, Computerized adaptive testing, Item paramete