한국어 문법 학습 도구로서 ChatGPT의 활용 가능성 탐구

Abstract

This study aims to explore the performance of using ChatGPT as a Korean grammar learning tool. For this reason, the accuracy and suitability of ChatGPT's outputs for learning sixty Korean grammar items are evaluated respectively. Meanwhile, prompt engineering and inferential statistic are used to ensure the reliability and validity of the evaluation. As a result, the probability that ChatGPT provides accurate learning contents for Korean grammar items is inferred at 67.8-86.7%. When ChatGPT is used to examine generated sentences using a Korean grammar item, the probability that it provides feedback accurately is inferred at 92.3-99.9% for correct sentences and 62.3-82.5% for ill-formed sentences. On the other hand, the output shows that ChatGPT can provide learning contents comprehensively. However, a number of learning materials beyond the learners' proficiency level and several obscure explanations for ill-formed sentences are also observed. Based on our results, we suggest exercising caution when using ChatGPT for Korean grammar learning and believe that supervision or examination by Korean language instructors is essential.