프롬프트 엔지니어링(Prompt Engineering)을 활용한‘진료수행시험 연습용 챗봇(CPX Practicing Chatbot)’ 시범 개발Pilot Development of a 'Clinical Performance Examination (CPX) Practicing Chatbot' Utilizing Prompt Engineering
- Other Titles
- Pilot Development of a 'Clinical Performance Examination (CPX) Practicing Chatbot' Utilizing Prompt Engineering
- Authors
- 김준동; 이혜윤; 김지환; 김창업
- Issue Date
- Mar-2024
- Publisher
- 대한한의학회
- Keywords
- CPX(Clinical Performance Examination); AI(Artificial Intelligence); LLM(Large language model); Chatbot; Medical Education
- Citation
- 대한한의학회지, v.45, no.1, pp 200 - 212
- Pages
- 13
- Journal Title
- 대한한의학회지
- Volume
- 45
- Number
- 1
- Start Page
- 200
- End Page
- 212
- URI
- https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/91265
- ISSN
- 1010-0695
2288-3339
- Abstract
- Objectives: In the context of competency-based education emphasized in Korean Medicine, this study aimed to develop a pilot version of a CPX (Clinical Performance Examination) Practicing Chatbot utilizing large language models with prompt engineering.
Methods: A standardized patient scenario was acquired from the National Institute of Korean Medicine and transformed into text format. Prompt engineering was then conducted using role prompting and few-shot prompting techniques. The GPT-4 API was employed, and a web application was created using the gradio package. An internal evaluation criterion was established for the quantitative assessment of the chatbot's performance.
Results: The chatbot was implemented and evaluated based on the internal evaluation criterion. It demonstrated relatively high correctness and compliance. However, there is a need for improvement in confidentiality and naturalness.
Conclusions: This study successfully piloted the CPX Practicing Chatbot, revealing the potential for developing educational models using AI technology in the field of Korean Medicine. Additionally, it identified limitations and provided insights for future developmental directions.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - ETC > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/91265)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.