Can ChatGPT make reading comprehension testing items on par with human experts?
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Shin, Dongkwang | - |
dc.contributor.author | Lee, Jang Ho | - |
dc.date.accessioned | 2023-12-01T02:42:10Z | - |
dc.date.available | 2023-12-01T02:42:10Z | - |
dc.date.issued | 2023-10 | - |
dc.identifier.issn | 1094-3501 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/68703 | - |
dc.description.abstract | Given the recent increased interest in ChatGPT in the L2 teaching and learning community, the present study sought to examine ChatGPT's potential as a resource for generating L2 assessment materials on par with those created by human experts. To this end, we extracted five reading passages and testing items in the format of multiple-choice questions from the English section of the College Scholastic Ability Test (CSAT) in South Korea. Additionally, we used ChatGPT to generate another set of readings and testing items in the same format. Next, we developed a survey made up of Likert-scale questions and open-ended response questions that asked about participants' perceptions of the diverse aspects of the target readings and testing elements. The study's participants were comprised of 50 pre-and in-service teachers, and they were not informed of the target materials' source or the study's purpose. The survey's results revealed that the CSAT and ChatGPT-developed readings were perceived as similar in terms of naturalness of the target passages' flow and expressions. However, the former was judged as having included more attractive multiple-choice options, as well as having a higher completion level regarding testing items. Based on such outcomes, we then present implications for L2 teaching and future research. | - |
dc.format.extent | 14 | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | UNIV HAWAII, NATL FOREIGN LANGUAGE RESOURCE CENTER | - |
dc.title | Can ChatGPT make reading comprehension testing items on par with human experts? | - |
dc.type | Article | - |
dc.identifier.bibliographicCitation | LANGUAGE LEARNING & TECHNOLOGY, v.27, no.3, pp 27 - 40 | - |
dc.description.isOpenAccess | N | - |
dc.identifier.wosid | 001083711700003 | - |
dc.citation.endPage | 40 | - |
dc.citation.number | 3 | - |
dc.citation.startPage | 27 | - |
dc.citation.title | LANGUAGE LEARNING & TECHNOLOGY | - |
dc.citation.volume | 27 | - |
dc.type.docType | Article | - |
dc.publisher.location | 미국 | - |
dc.subject.keywordAuthor | Artificial Intelligence | - |
dc.subject.keywordAuthor | Automated Item Generation | - |
dc.subject.keywordAuthor | ChatGPT | - |
dc.subject.keywordAuthor | Content Generation | - |
dc.relation.journalResearchArea | Education & Educational Research | - |
dc.relation.journalResearchArea | Linguistics | - |
dc.relation.journalWebOfScienceCategory | Education & Educational Research | - |
dc.relation.journalWebOfScienceCategory | Linguistics | - |
dc.description.journalRegisteredClass | ssci | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.