Publication
Title
Teksten beoordelen met criterialijsten of via paarsgewijze vergelijking : een afweging van betrouwbaarheid en tijdsinvestering = Judging texts with rubrics and comparative judgement: Taking into account reliability and time investment
Author
Abstract
Writing researchers and practitioners both aim for reliable judgements with a minimum investment of time. This study focuses on two judgement methods, rubrics and comparative judgement. For each method, we studied how long it took to complete a judgement per text. Moreover, we examined how the reliability evolves in relation to the time spent judging. Judges were randomly attributed to the rubrics condition or the comparative judgement condition. In each condition, the same 35 texts were judged and time was tracked during this process. Results show that, when reliability is operationalized as the stability of the rank order, both methods require a comparable time investment to reach a stable rank order. Future research on the reliability and time investment should take into account the time needed for developing the rubric and to set up a comparative judgement assessment. Further research should also clarify whether the findings can be generalized to other texts and rubrics.
Language
Dutch
Source (journal)
PEDAGOGISCHE STUDIEN
Publication
2017
Volume/pages
94 :4 (2017) , p. 283-303
ISI
000435675200005
Full text (open access)
UAntwerpen
Faculty/Department
Research group
Publication type
Subject
Affiliation
Publications with a UAntwerp address
External links
Web of Science
Record
Identification
Creation 10.07.2018
Last edited 20.09.2021
To cite this reference