학문 목적 한국어 말하기 평가 도구 개발 연구

Abstract

The overall purpose of this study was to develop a Korean speaking test for academic purposes for foreign students. As part of this purpose, this study particularly focused on the processes of designing a test framework and verifying the developed test items. The test framework was developed through theoretical reviews, surveys, and the Delphi Method. We suggest these four constructs for the final test version: “vocabulary and grammar,” “pronunciation and fluency,” “content,” and “organization.” We also added “overall performance” as a holistic criterion. Six different tasks for the test were derived from the three types of discourse in academic situations: narratives, explanations, and persuasions. Within the test framework, we also developed many test items and finally developed a trial test set of Korean Speaking Test for Academic Purposes(KoSTAP), an Internet-based Korean speaking test. A total of 120 foreign students participated in the KoSTAP test, and we collected 720 responses. Nine Korean speaking test experts scored the tests in accordance with the scoring rubric we developed. For statistical validity, we conducted a statistical analysis of test results for the Items, constructs, raters, and test-takers. The results showed that the overall test reliability was very high, and the interclass-correlation between the test types and examinee groups was at a good level. To clarify the relationship between the tasks and constructs, we also conducted a correlation analysis and found that some test items showed low quality when estimated by task format and prompt. An analysis of test-takers also showed that there were significant differences in the Korean language levels and academic levels among the them.