The Development of a Standardized Rater Training Program on Essay Scoring: A Case Study
- Authors
- 장소영
- Issue Date
- 2011
- Publisher
- 한국영어교육학회
- Keywords
- teacher-rater training model; rater reliability; program evaluation
- Citation
- 영어교육, v.66, no.3, pp 201 - 231
- Pages
- 31
- Journal Title
- 영어교육
- Volume
- 66
- Number
- 3
- Start Page
- 201
- End Page
- 231
- URI
- https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/46706
- DOI
- 10.15858/engtea.66.3.201109.201
- ISSN
- 1017-7108
- Abstract
- The primary purposes of this study are to identify the characteristics of modeling a rater training program and to develop an efficient training model at the University of Illinois at Urbana-Champaign. For these purposes, this study proposes that a rater training program should be standardized by accomplishing innovative systematic changes that consider multiple aspects. This study utilized a modified version of Lynch’s program evaluation model (1996, 2003) to collect evidence from different sources, including data drawn from the entire evaluation process ranging from needs analysis to a feedback system based on the final product of the evaluation. Mixed methods were proposed for the data analysis.
Quantitative data analysis was proposed for analyzing the surveys, and the rating corpus. Qualitative and document analysis were also essential for analyzing relevant training materials and workshop observation as well as exploring the degree of change in the perceptions of the raters. The results of this study provide educational implications for language testing. The salient value of this study is the collaboration with stakeholders in a test administration situation. Raters’ concerns and challenges were clearly identified, shared, and resolved with the practitioners.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Education > Department of English Education > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/46706)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.