Assessing critical reading performance in an EAP classroom

Thesis (M.Ed.)--University of Melbourne, Dept. of Education, 2003A widespread perception among EAP teachers and course designers in Australia is that Asian university students need some formal training in text analysis and critical thought. To be more precise, Asian students are often portrayed as victims of Asian education, where students are taught to rote learn and memorise, rather than question and analyse as they might be taught in Australia. EAP classes often rest on generalisations about cultural differences, constructing critical reading tasks on the assumption that the problems students encounter in completing critical reading tasks relates to the way they read rather than how they respond to what they read (that is, their familiarity and ability to reproduce arguments in acceptable and culturally expected ways). While EAP researchers have spent considerable energy on improving critical reading methodologies, there has been very little research on the assessment of critical reading in EAP classes. In particular, very little research has offered any explanation of what might constitute evidence of learning to read and respond at a high level. In this thesis, I develop a criterion-referenced critical reading performance rubric, informed by Ballard and Clanchy's (1984; 1988; 1997) research on critical analysis and Toulmin's (1958; 1972; 1984) theories on reasoning and argumentation, to examine the clarity, evidence and logic (CEL) of students' critical reading responses and the influence of text selection on student reasoning skills. Secondly, I explore with students some factors they perceive as affecting their reading performances including text selection. The findings of this research reveal that there are distinct patterns in critical reading performances characterising low, medium and high level students, and that subject matter may be less significant to students' reading performances than they seem to believe. In discussing critical reading performances with students, they identified several factors such as a lack of subject knowledge, a lack of time and a misunderstanding of their purpose in completing the task which significantly affected their performance. Additionally, students perceived their future performances could be improved by choosing texts with subject matter more closely aligned to their academic field. The findings also reveal that most students feel that critically examining topics relating to Australian social issues are not helpful to the overall development of their critical reading skills