NEW FACETS을 활용한 채점자료 분석방법Understanding rating patterns through New FACETS program
- Authors
- 신동일; 설현수
- Issue Date
- 2005
- Publisher
- 한국외국어교육학회
- Keywords
- testing/rater training; 평가/채점자 훈련
- Citation
- Foreign Languages Education, v.12, no.2, pp 191 - 212
- Pages
- 22
- Journal Title
- Foreign Languages Education
- Volume
- 12
- Number
- 2
- Start Page
- 191
- End Page
- 212
- URI
- https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/60682
- ISSN
- 1226-4628
2384-1427
- Abstract
- Recent developments in multifaceted Rasch measurement (Linacre, 1989) have made possible new kinds of investigations of facets of speaking test samples. The Rasch measurement, implemented through the computer program FACETS 3.56 version, can provide useful information in separate graphics and tables for the facets (e.g., test takers’ ability, item difficulty, and rater severity, bias analyses). This study investigates the roles of newly updated FACETS in the context of rater monitoring of English speaking test. Data for this study came from G-TELP Speaking Test. The performance of 50 candidates on the speaking test was multiply rated and analyzed using the most updated FACETS version of Rasch model. After exploring the extent to which new graphics and analyses tables of new FACETS are useful in rater monitoring, it was suggested that other tester groups should bring analytic tools like FACETS to effectively analyze raters’ consistency patterns as well as other rating patterns of individual raters for specific test tasks and criteria.
- Files in This Item
-
Go to Link
- Appears in
Collections - College of Humanities > Department of English Language and Literature > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.