Publication
Title
Quantifying the quality difference between L1 and L2 essays : a rating procedure with bilingual raters and L1 and L2 benchmark essays
Author
Abstract
It is the consensus that, as a result of the extra constraints placed on working memory, texts written in a second language (L2) are usually of lower quality than texts written in the first language (L1) by the same writer. However, no method is currently available for quantifying the quality difference between L1 and L2 texts. In the present study, we tested a rating procedure for enabling quality judgments of L1 and L2 texts on a single scale. Two main features define this procedure: 1) raters are bilingual or near native users of both the L1 and L2; 2) ratings are performed with L1 and L2 benchmark texts. Direct comparisons of observed L1 and L2 scores are only warranted if the ratings with L1 and L2 benchmarks are parallel tests and if the ratings are reliable. Results showed that both conditions are met. Effect sizes (Cohens d) indicate that, while score variances are large, there is a relatively large added L2 effect: in the investigated population, L2 text scores were much lower than L1 text scores. The tested rating procedure is a promising method for cross-national comparisons of writing proficiency.
Language
English
Source (journal)
Language testing. - London, 1984, currens
Publication
London : 2013
ISSN
0265-5322 [print]
1477-0946 [online]
Volume/pages
30(2013), p. 71-97
ISI
000313592800004
Full text (Publisher's DOI)
Full text (publisher's version - intranet only)
UAntwerpen
Faculty/Department
Research group
Publication type
Subject
External links
Web of Science
Record
Identification
Creation 04.03.2014
Last edited 02.10.2017
To cite this reference