Possibility of independent use of the yes/no Angoff and Hofstee methods for the standard setting of the Korean Medical Licensing Examination written test: a descriptive studyopen access
- Authors
- Kim, Do Hwan; Kang, Ye Ji; Park, Hoon-Ki
- Issue Date
- Dec-2022
- Publisher
- NLM (Medline)
- Keywords
- Educational measurement; Humans; Physicians; Republic of Korea; Undergraduate medical education
- Citation
- Journal of educational evaluation for health professions, v.19, pp.1 - 7
- Indexed
- SCOPUS
KCI
- Journal Title
- Journal of educational evaluation for health professions
- Volume
- 19
- Start Page
- 1
- End Page
- 7
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/185114
- DOI
- 10.3352/jeehp.2022.19.33
- ISSN
- 1975-5937
- Abstract
- Purpose
This study aims to apply the yes/no Angoff and Hofstee methods to actual Korean Medical Licensing Examination (KMLE) 2022 written examination data to estimate cut scores for the written KMLE.
Methods
Fourteen panelists gathered to derive the cut score of the 86th KMLE written examination data using the yes/no Angoff method. The panel reviewed the items individually before the meeting and shared their respective understanding of the minimum-compatibility physician. The standard setting process was conducted in 5 rounds over a total of 800 minutes. In addition, 2 rounds of the Hofstee method were conducted before starting the standard setting process and after the second round of yes/no Angoff.
Results
For yes/no Angoff, as each round progressed, the panel’s opinion gradually converged to a cut score of 198 points, and the final passing rate was 95.1%. The Hofstee cut score was 208 points out of a maximum 320 with a passing rate of 92.1% at the first round. It scored 204 points with a passing rate of 93.3% in the second round.
Conclusion
The difference between the cut scores obtained through yes/no Angoff and Hofstee methods did not exceed 2% points, and they were within the range of cut scores from previous studies. In both methods, the difference between the panelists decreased as rounds were repeated. Overall, our findings suggest the acceptability of cut scores and the possibility of independent use of both methods.
- Files in This Item
-
- Appears in
Collections - 서울 의과대학 > 서울 가정의학교실 > 1. Journal Articles
- 서울 의과대학 > 서울 의학교육학교실 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/185114)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.