Search Advanced Search Adode Reader(link)
Download PDF Export Citaion korean bibliography PMC previewer
ISSN : 1017-7108(Print)
ISSN : (Online)
English Teaching Vol.70 No.1 pp.97-121
DOI : https://doi.org/10.15858/engtea.70.1.201503.97

Exploring Rater Behaviors During a Writing Assessment Discussion

Susie Kim,Hee-Kyung Lee

Abstract

This study explores a discussion held among raters for a writing assessment in a Korean university. It investigates rater behaviors that influence their decision-making processes as revealed in their interaction during discussion. Four raters independently assessed student writing samples using CEFR scales and then held a discussion session to agree on a single score for each sample. Observation and analysis of the rater discussion showed that there were differences in the degree to which individual raters’ initial judgments were reflected in the final decisions and that each rater’s argument style affected the degree. Raters’ personality dynamics, appreciation of student effort, and comprehension of students’ intended meaning were found to be prominent factors that influenced the process of score decisions. These findings have important implications for the use of discussion in performance assessment and for the rating process in general.

초록

Figure

Table