NEW FACETS을 활용한 채점자료 분석방법

Abstract

Recent developments in multifaceted Rasch measurement (Linacre, 1989) have made possible new kinds of investigations of facets of speaking test samples. The Rasch measurement, implemented through the computer program FACETS 3.56 version, can provide useful information in separate graphics and tables for the facets (e.g., test takers’ ability, item difficulty, and rater severity, bias analyses). This study investigates the roles of newly updated FACETS in the context of rater monitoring of English speaking test. Data for this study came from G-TELP Speaking Test. The performance of 50 candidates on the speaking test was multiply rated and analyzed using the most updated FACETS version of Rasch model. After exploring the extent to which new graphics and analyses tables of new FACETS are useful in rater monitoring, it was suggested that other tester groups should bring analytic tools like FACETS to effectively analyze raters’ consistency patterns as well as other rating patterns of individual raters for specific test tasks and criteria.