Evaluating the Santa Maria College information literacy program

Master of EducationThis is an impact study, which evaluates an Information Literacy Program that has been running in the Santa Maria College Library since February 2000. It investigates the effectiveness of the Program inputs and processes and seeks to identify impacts on learning in student outputs and College wide outcomes. The study builds on previous research that was conducted from 2000 to 2004 and seeks to develop new understandings through new methods. This study draws on literature that examines methods of collecting evidence of learning impact in school libraries. The literature recommends micro-research in secondary schools that examines students' skills before and after they have been involved in integrated information literacy instruction, as well as empirical studies about the impact of the six step research process model on learning. The literature also suggests investigation of the impact of school libraries on the broad aspects of learning, and the development and application of new methods for collecting qualitative data in the library setting. From Terms One to Term Four in 2005, mixed methods were used to capture evidence of student learning in the Santa Maria College Library. Students were observed as they carried out Program research tasks. The assignments that they produced at the end of the research process were assessed. Surveys and focus group interviews explored the perceptions of a sample of the students and teachers who participated in the Program. In exploring the data, changes in learning behaviour and attitudes to the research process were identified and analysed. The effectiveness of various aspects of the Program such as task design, explicit process instruction, cognitive strategies, note taking scaffolds and assessment practices were examined. Two theoretical frameworks synthesised from the literature were used in the research. The first framework is based on criteria for effective libraries such as staffing, funding, collection size and technological infrastructure. The second framework combines the effective approaches to learning in school libraries that are evident in the literature. Those frameworks were applied to assess the pre-conditions for learning in the Santa Maria Library. A third framework based on criteria that identify outcomes and indicators of student learning in school libraries, was used to identify evidence of student learning across the data sets. The key research questions were used to organise the discussion of the findings. The findings demonstrated that student outcomes have improved in a broad range of learning experiences. The study deepened my understanding of the distinctive features of the Program and its strengths and weaknesses. The strengths included: the use of constructivist pedagogy and inquiry learning; the collaborative planning, implementation and review processes; the infusion of the learning activities in real units of work; the learning scaffolds and instructional interventions at the point of need; and the assessment and feedback strategies. All of those inputs and processes are critical success factors in the Program. The note taking grids and the associated skill development in reading for meaning, identifying and recording key points, and combining information for final products are particularly effective aspects of the Program, which were highly regarded by the students. The weaknesses of the Program included: the gradual erosion of collaborative planning, implementation and evaluation processes; a general feeling of Program fatigue; the fact that the assessment of student outputs to track Progress is not standard practice; and the lack of a process for fading scaffolds in the Year 9 and 10 levels to shift control of the learning process from the teachers and teacher librarians to the students as they move through the Program. The study incorporates a series of recommendations for ongoing monitoring, and future Program delivery and implementation