Portfolio assessment during medical internships: how to obtain a reliable and feasible assessment procedure?Portfolio assessment during medical internships: how to obtain a reliable and feasible assessment procedure?
Faculty of Medicine and Health Sciences
Primary and interdisciplinary care Antwerp (ELIZA)
Laboratory Experimental Medicine and Pediatrics (LEMP)
Antwerp Surgical Training, Anatomy and Research Centre (ASTARC)
Education for health / World Health Organization. - Geneva
22(2009):3, p. 313,1-313,9
University of Antwerp
Background: A portfolio is used to mentor and assess students clinical performance at the workplace. However, students and raters often perceive the portfolio as a time-consuming instrument. Purpose: In this study, we investigated whether assessment during medical internship by a portfolio can combine reliability and feasibility. Methods: The domain-oriented reliability of 61 double-rated portfolios was measured, using a generalisability analysis with portfolio tasks and raters as sources of variation in measuring the performance of a student. Results: We obtained reliability (Ö coefficient) of 0.87 with this internship portfolio containing 15 double-rated tasks. The generalisability analysis showed that an acceptable level of reliability (Ö = 0.80) was maintained when the amount of portfolio tasks was decreased to 13 or 9 using one and two raters, respectively. Conclusions: Our study shows that a portfolio can be a reliable method for the assessment of workplace learning. The possibility of reducing the amount of tasks or raters while maintaining a sufficient level of reliability suggests an increase in feasibility of portfolio use for both students and raters.