MAC: multimodal, attention-based cybersickness prediction modeling in virtual reality
- Authors
- Jeong, Dayoung; Paik, Seungwon; Noh, YoungTae; Han, Kyungsik
- Issue Date
- Sep-2023
- Publisher
- Springer Science and Business Media Deutschland GmbH
- Keywords
- Cybersickness; Deep learning; User characteristics; Virtual reality
- Citation
- Virtual Reality, v.27, no.3, pp.2315 - 2330
- Indexed
- SCIE
SCOPUS
- Journal Title
- Virtual Reality
- Volume
- 27
- Number
- 3
- Start Page
- 2315
- End Page
- 2330
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/191975
- DOI
- 10.1007/s10055-023-00804-0
- ISSN
- 1359-4338
- Abstract
- Cybersickness is one of the greatest barriers to the adoption of virtual reality. A growing body of research has focused on identifying the characteristics of cybersickness and finding ways to mitigate it through the utilization of data from VR content, physiological signals, and body movement, along with artificial intelligence techniques. In this work, we extend prior research on cybersickness prediction by considering the role of different data modalities. We propose a novel deep learning model named multimodal, attention-based cybersickness (MAC), which learns temporal sequences and characteristics of video flows, eye movement, head movement, and electrodermal activity. Based on data collected from 27 participants, we demonstrate the effectiveness of MAC, showing an F1-score of 0.87. Our experimental results further show not only the influences of gender and prior VR experience but also the effectiveness of the attention mechanism on model performance, emphasizing the importance of considering the characteristics of data types and users in cybersickness modeling.
- Files in This Item
-
Go to Link
- Appears in
Collections - ETC > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/191975)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.