Portfolio assessment during medical internships: how to obtain a reliable and feasible assessment procedure?
Faculty of Medicine and Health Sciences
Education for health / World Health Organization. - Geneva
, p. 313,1-313,9
University of Antwerp
Background: A portfolio is used to mentor and assess students clinical performance at the workplace. However, students and raters often perceive the portfolio as a time-consuming instrument. Purpose: In this study, we investigated whether assessment during medical internship by a portfolio can combine reliability and feasibility. Methods: The domain-oriented reliability of 61 double-rated portfolios was measured, using a generalisability analysis with portfolio tasks and raters as sources of variation in measuring the performance of a student. Results: We obtained reliability (Ö coefficient) of 0.87 with this internship portfolio containing 15 double-rated tasks. The generalisability analysis showed that an acceptable level of reliability (Ö = 0.80) was maintained when the amount of portfolio tasks was decreased to 13 or 9 using one and two raters, respectively. Conclusions: Our study shows that a portfolio can be a reliable method for the assessment of workplace learning. The possibility of reducing the amount of tasks or raters while maintaining a sufficient level of reliability suggests an increase in feasibility of portfolio use for both students and raters.