Rating scale impact on EFL essay marking: A mixed-method study

Simple item page
dc.contributor.authorBarkaoui, Khaled
dc.date.accessioned2009-08-17T15:19:04Z
dc.date.available2009-08-17T15:19:04Z
dc.date.issued2007
dc.description.abstractEducators often have to choose among different types of rating scales to assess second-language (L2) writing performance. There is little research, however, on how different rating scales affect rater performance. This study employed a mixed-method approach to investigate the effects of two different rating scales on EFL essay scores, rating processes, and raters’ perceptions. Four EFL teachers in Tunisia rated a set of 24 EFL essays silently and two subsets of four essays while thinking aloud using a holistic scale and then a multiple-trait rating scale. The essay scores were analyzed using G-theory while the think-aloud protocols were coded in terms of Cuming, Kantor, and Power's (Cumming, A., Kantor, R., & Powers, D. (2002). Decision making while rating ESL/EFL writing tasks: A descriptive framework. Modern Language Journal, 86 (1), 67–96.) rater decision-making scheme. The holistic scale resulted in higher inter-rater agreement. Raters employed similar processes with both rating scales. Raters were the main source of variability in terms of scores and decision-making behavior. These findings have implications for writing assessment practices and for further research.
dc.identifier.citationBarkaoui, K. (2007). Rating scale impact on EFL essay marking: A mixed-method study. Assessing Writing, 12, 86-107en
dc.identifier.urihttp://hdl.handle.net/10315/2813
dc.language.isoenen
dc.publisherElsevieren
dc.rightsAttribution 4.0 International (CC BY 4.0)
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectEFL essay rating
dc.subjectHolistic rating
dc.subjectMultiple-trait rating
dc.subjectThink-aloud protocols
dc.subjectGeneralizability theory
dc.subjectMixed-method research
dc.subjectWriting assessment
dc.titleRating scale impact on EFL essay marking: A mixed-method studyen_US
dc.typeArticleen

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Rating scale impact on EFL essay marking- A mixed-method study.pdf
Size:
812.9 KB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.83 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Research and publications

All items in the YorkSpace institutional repository are protected by copyright, with all rights reserved except where explicitly noted.