ChatGPT 4.0의 중등교원 임용시험 전공영어 기출문제 풀이수행능력 탐색 연구

Abstract

In recent years, ChatGPT has integrated itself into applied linguistics and language education research, with studies proposing different ways to use this new technology in second language teaching. As part of these efforts, the present study aimed to investigate ChatGPT’s ability to solve the domain-specific questions of high-stakes exams. To this end, the dataset for this study consisted of multiple-choice questions taken from the teacher certification exams for prospective English teachers, developed by the Korea Institute for Curriculum and Evaluation between 2009 and 2013. The authors then asked ChatGPT to solve each question by entering them as prompts. The results showed that ChatGPT’s average percentage of correct answers was 66%, with the percentage slightly lower for the English Literature and Linguistics subsections than for the English Education Theories and General English subsections. The qualitative analysis also revealed four different patterns in the errors made by ChatGPT when answering the target questions, which we illustrate with specific examples. Based on these findings, we have provided implications for pedagogy and future research.