Publication
Title
Instruments for school self-evaluation: lost in translation: a study on respondents' cognitive processing
Author
Abstract
School self-evaluation (SSE), as an important leverage for quality assurance, often relies on surveys among staff members to collect information on the schools functioning. The extent to which respondents cognitively process items as developers intended them determines the cognitive validity of SSE results. However, it is unclear what problems occur in respondents cognitive processes which lead to cognitively invalid SSE results and how respondents positions in the school affects these cognitive processes. This study draws on cognitive interviews conducted with 20 teachers and principals to understand their thinking process while answering an SSE survey. Cognitively invalid results were analysed using a content analysis to identify problems in respondents cognitive processes. Findings showed that respondents experience semantic and syntactical issues when interpreting items. While elaborating, problems were found regarding items topic and focus, particularly concerning whom to make a statement about. Issues also emerged in the response stage, especially that the dont know option was not used as intended. Respondents positions influence their understanding about whom a statement is required and how self-evident some items are to them. These problems should be taken into account by developers of SSE surveys and other instruments that intend to measure organisational characteristics.
Language
English
Source (journal)
Educational assessment, evaluation and accountability. - Dordrecht, 2009, currens
Publication
Dordrecht : 2017
ISSN
1874-8597
DOI
10.1007/S11092-017-9270-4
Volume/pages
29 :4 (2017) , p. 397-420
ISI
000414713700005
Full text (Publisher's DOI)
Full text (publisher's version - intranet only)
UAntwerpen
Faculty/Department
Research group
Project info
Self perception or self deception? The use of self evaluation instruments in organisational settings.
Publication type
Subject
Affiliation
Publications with a UAntwerp address
External links
Web of Science
Record
Identifier
Creation 10.11.2017
Last edited 09.10.2023
To cite this reference