한국어 말하기 평가에서 나타난 채점자 신뢰도 및 일관성 연구
DC Field | Value | Language |
---|---|---|
dc.contributor.author | 조윤정 | - |
dc.contributor.author | 양명희 | - |
dc.date.available | 2019-03-08T05:57:58Z | - |
dc.date.issued | 2018 | - |
dc.identifier.issn | 1598-9542 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/2861 | - |
dc.description.abstract | This study aims to examine the reliability and consistency of raters of Korean speaking tests. This basic research can identify the type of education that can enhance the reliability of rating in speaking tests, which are mainly assessed using subjective assessment criteria. In this study, we intended to study the rating tendencies, reliability, and consistency of raters by conducting two separate experiments under the same conditions and separated by a certain interval. As a result of the analysis using the FACETS program based on the Many-Facets Rasch Measurement model, the second rating saw an overall improvement in inter-rater reliability; however, raters’ consistency varied regardless of their career experience in the field of Korean language education. It is necessary to train raters to improve assessment reliability, and these study results confirmed that individualized training that can be customized for each rater’s personality or characteristics is needed. In addition, this could be an alternative to training raters if the intention is to improve self-consistency through self-observation by using scientific tools that can measure the rater’s reliability and consistency. | - |
dc.description.abstract | This study aims to examine the reliability and consistency of raters of Korean speaking tests. This basic research can identify the type of education that can enhance the reliability of rating in speaking tests, which are mainly assessed using subjective assessment criteria. In this study, we intended to study the rating tendencies, reliability, and consistency of raters by conducting two separate experiments under the same conditions and separated by a certain interval. As a result of the analysis using the FACETS program based on the Many-Facets Rasch Measurement model, the second rating saw an overall improvement in inter-rater reliability; however, raters’ consistency varied regardless of their career experience in the field of Korean language education. It is necessary to train raters to improve assessment reliability, and these study results confirmed that individualized training that can be customized for each rater’s personality or characteristics is needed. In addition, this could be an alternative to training raters if the intention is to improve self-consistency through self-observation by using scientific tools that can measure the rater’s reliability and consistency. | - |
dc.format.extent | 24 | - |
dc.publisher | 한국화법학회 | - |
dc.title | 한국어 말하기 평가에서 나타난 채점자 신뢰도 및 일관성 연구 | - |
dc.title.alternative | A Study on Raters’ Reliability and Consistency Observed in Korean Speaking Tests | - |
dc.type | Article | - |
dc.identifier.doi | 10.18625/jsc.2018..40.105 | - |
dc.identifier.bibliographicCitation | 화법연구, no.40, pp 105 - 128 | - |
dc.identifier.kciid | ART002352321 | - |
dc.description.isOpenAccess | N | - |
dc.citation.endPage | 128 | - |
dc.citation.number | 40 | - |
dc.citation.startPage | 105 | - |
dc.citation.title | 화법연구 | - |
dc.publisher.location | 대한민국 | - |
dc.subject.keywordAuthor | 말하기 수행 평가 | - |
dc.subject.keywordAuthor | 신뢰도 | - |
dc.subject.keywordAuthor | 채점자 간 신뢰도 | - |
dc.subject.keywordAuthor | 채점자 내 신뢰도 | - |
dc.subject.keywordAuthor | 일관성 | - |
dc.subject.keywordAuthor | 엄격성 | - |
dc.subject.keywordAuthor | 채점자 훈련 | - |
dc.subject.keywordAuthor | speaking performance test | - |
dc.subject.keywordAuthor | reliability | - |
dc.subject.keywordAuthor | inter-rater reliability | - |
dc.subject.keywordAuthor | intra-rater reliability | - |
dc.subject.keywordAuthor | consistency | - |
dc.subject.keywordAuthor | severity | - |
dc.subject.keywordAuthor | rater training | - |
dc.description.journalRegisteredClass | kci | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.