Emotion and Body Movement: A Comparative Study of Automatic Emotion Recognition Using Body Motions
- Authors
- Cho, Youngwug; Jung, Myeongul; Kim, Kwanguk
- Issue Date
- Oct-2022
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- Computing methodologiesArtificial intelligence; deep learning; Emotion; Human-centered computing-Human computer interaction (HCI) Interaction paradigmsVirtual reality; Human-centered computing-Human computer interaction (HCI)Interaction paradigms Mixed/augmented reality; Human-centered computing-Human computer interaction (HCI)Interaction techniquesGestural input; motion capture; pose estimation
- Citation
- Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022, pp.768 - 771
- Indexed
- SCOPUS
- Journal Title
- Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2022
- Start Page
- 768
- End Page
- 771
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/182408
- DOI
- 10.1109/ISMAR-Adjunct57072.2022.00162
- ISSN
- 2771-1102
- Abstract
- Emotion recognition through body movement in both real and virtual worlds is an important research topic along with facial expression and voice recognition. Computational methods to recognize emotions based on body movement have been developed to utilize skeletal data and motion capture systems, and 2D and 3D pose estimation methods have recently been proposed. Although each of these methodologies involves advantages and disadvantages, they have not been compared with same data. In this study, we collected seven types of motion data associated with specified emotional states from 25 participants, including happiness, sadness, anger, disgust, fear, surprise, and a neutral emotion. We compared three methodologies, including motion capture, 2D pose estimation, and 3D pose estimation, along with human evaluations as a baseline. The results show that measurement through motion capture showed the highest performance, and the 2D and 3D pose estimation also showed relatively high performance compared to the human evaluators' results. These findings suggest that the existing methodologies can be utilized to perform emotion recognition.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 컴퓨터소프트웨어학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/182408)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.