Assessing clinical competence: a pilot project to evaluate the feasibility of a standardized patient -- based practical examination as a component of the Swiss certification process

PURPOSE: advances in the assessment of clinical competence have prompted medical schools and licensing authorities to complement written and oral tests with practical ones. The purposes of this project were to (1) determine how clinical competencies not effectively addressed on the present Swiss federal examinations can be assessed adequately on a standardised patient-based practical examination (SCE) and (2) evaluate the SCE validity, reliability and feasibility. METHOD: a bilingual, three-hour standardised patient-based clinical examination was pilot tested in 2003 with 48 volunteered fifth and sixth-year students from the five Swiss medical schools. All students took the same eight 15-minute patient cases. To ensure the test content validity, test cases were selected by a multi-disciplinary and -institutional committee of clinical faculty on the basis of predefined exam blueprint criteria and in reference to the Swiss catalogue of learning objectives. RESULTS: moderate correlations between the SCE and the existing Federal final written examinations (0.46) and the newly pilot-tested structured oral examination or SOE (0.56) [3] suggested that they were complementary to one another and that each might emphasise aspects of the clinical competence which others might not. The reliability (a coefficient) of the SCE scores ranged from 0.73 to 0.77. CONCLUSIONS: limited experiences gathered throughout the SCE pilot project demonstrated its feasibility. Preliminary results suggested that SCE scores had a good level of construct validity and reliability and seemed to complement scores obtained on the final certification written examinations and the newly tested SOE. These results, however, need to be further confirmed with larger samples studies