Publication
Title
The prevalence of careless response behaviour and its consequences on data quality in self-report questionnaires on student learning
Author
Abstract
Introduction: Self-report questionnaires are widely used in high schools and universities to gain insights into students’ learning strategies and enhance the quality of their education. However, it is important to acknowledge the possibility of respondents being inattentive when completing these questionnaires. While reliability analyses are typically performed at the group level, when providing individual feedback, it is crucial that each respondent’s results are reliable. This study aimed to evaluate the prevalence of careless response behaviour in a questionnaire concerning student learning. Methods: Data analysis encompassed a substantial sample of 12,000+ students in their final two years of secondary education, averaging around 17 years of age. Employing five complementary detection techniques, the study identified instances of careless responding present in the questionnaire data. Results: Our results underscore a notable prevalence of careless response behaviour among the surveyed students. Application of the five detection techniques revealed a substantial number of instances indicating inattentive responding. Furthermore, the questionnaire’s measurement scales were evaluated for reliability. The study noted the presence of carelessness but observed minimal impact on group-level results. Discussion: The outcomes of this study hold important implications for using self-report questionnaires in education. The prevalence of careless responding emphasizes the need for scrutinizing individual responses. Despite careless responses, their influence on overall group-level data integrity seems restricted. Nonetheless, the study underscores the importance of cautiously interpreting individual-level outcomes, particularly when using these results for individual feedback.
Language
English
Source (journal)
Frontiers in Education
Publication
Frontiers Media S.A. , 2023
ISSN
2504-284X
DOI
10.3389/FEDUC.2023.1197324
Volume/pages
8 (2023) , p. 1-13
Article Reference
1197324
ISI
001072782400001
Medium
E-only publicatie
Full text (Publisher's DOI)
Full text (open access)
UAntwerpen
Faculty/Department
Research group
Project info
FWO sabbatical 2022-2023 (Prof. V. Donche).
Reading to learn: an in-depth look into how students learn from academic texts using eye-tracking.
Investigating the impact of normed and personalised feedback instruments on the development of academic selfconcept and self-regulatory practices of students during first year higher education.
Publication type
Subject
Affiliation
Publications with a UAntwerp address
External links
Web of Science
Record
Identifier
Creation 21.09.2023
Last edited 25.04.2024
To cite this reference