LLM기반AI 서비스사용자경험비교연구 : ChatGPT와 Clova X를 중심으로A Comparative Study on LLM-based AI Service User Experience : Focusing on ChatGPT and Clova X
- Other Titles
- A Comparative Study on LLM-based AI Service User Experience : Focusing on ChatGPT and Clova X
- Authors
- 이서후; 김승인
- Issue Date
- Dec-2023
- Publisher
- 한국상품문화디자인학회
- Keywords
- 인공지능 서비스; ChatGPT; LLM 모델; 사용자 경험; 고객 여정 지도; Artificial Intelligence Services; ChatGPT; LLM Model; User Experience; Customer Journey Map
- Citation
- 상품문화디자인학연구, no.75, pp 11 - 22
- Pages
- 12
- Journal Title
- 상품문화디자인학연구
- Number
- 75
- Start Page
- 11
- End Page
- 22
- URI
- https://scholarworks.bwise.kr/hongik/handle/2020.sw.hongik/32551
- ISSN
- 2765-1568
- Abstract
- n the first half of 2023, Large Language Model (LLM) based on AI services have explosively grown and now influencing various aspects of society, including education policy, corporate practices, and the cultural utilization of technology. Consequently, there is a demand for the evaluation and improvement of user experiences tailored to LLM service products. This research compares two LLM services (ChatGPT 3.5 and Naver Clova X) across five themes and their respective sub-elements: 'Feedback and Articulation,' 'Intuitive Design,' 'Context and Purpose,' 'Engagement and Ethics,' and 'Naturalness.' An empirical study involved conducting online surveys with 80 domestic respondents, who were selected through pre-survey system. Then there were in-depth interviews with 8 participants among them. The results were analyzed using radial charts and tables for each theme and summarized with in-depth research comments, resulting in the creation of a User Experience Journey Map. The research revealed that the utility and accuracy of responses are more important than language proficiency. Both services needed to ensure the safety of personal information use, particularly in the aspect of 'Presence and Ethics'. Furthermore, various discussion points related to different usage stages (access and login, usage, re-access, and re-use) were raised to establish intimacy with users. This study aimed to provide user experience measurements specific to LLM services, along with concrete improvement suggestions, and to pave the way for various subsequent studies in this direction.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - International Desing for Advanced Studies > Digital Media Design > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hongik/handle/2020.sw.hongik/32551)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.