Improvement of robustness against electrode shift for facial electromyogram-based facial expression recognition using domain adaptation in VR-based metaverse applications
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Cha, Ho-Seung | - |
dc.contributor.author | Im, Chang Hwan | - |
dc.date.accessioned | 2023-10-04T06:40:45Z | - |
dc.date.available | 2023-10-04T06:40:45Z | - |
dc.date.created | 2023-03-08 | - |
dc.date.issued | 2023-09 | - |
dc.identifier.issn | 1359-4338 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/191624 | - |
dc.description.abstract | Recognition of users’ facial expressions and reflecting them on the face of the user’s virtual avatar is a key technology for realizing immersive virtual reality (VR)-based metaverse applications. As a method to realize this technology, a facial electromyogram (fEMG)-based facial expression recognition (FER) system, with the fEMG electrodes being attached on the pad of a VR headset, has recently been proposed. However, the performance of such FER systems has severely deteriorated when the locations of fEMG electrodes change by the re-wearing of the VR headset, requiring long and tedious calibration sessions every time the user wears the VR headset. In this study, we developed an fEMG-based FER system that is robust against electrode shifts by employing new signal processing techniques: covariate shift adaptation techniques in feature and classifier domains. To verify the feasibility of the proposed method, fEMG data were recorded while participants were making 11 facial expressions repeatedly in four sessions, between which they detached and reattached the fEMG electrodes on their faces. Our experiments showed that classification accuracy dropped from 88 to 79% by the change of the electrode locations when the proposed method was not applied, whereas the accuracy was significantly improved up to 86% when the proposed covariate shift adaptation method was employed. It is expected that the proposed method would contribute to enhancing the practicality of the fEMG-based FER, promoting the practical application of the fEMG-based FER to VR-based metaverse applications. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | SPRINGER LONDON LTD | - |
dc.title | Improvement of robustness against electrode shift for facial electromyogram-based facial expression recognition using domain adaptation in VR-based metaverse applications | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Im, Chang Hwan | - |
dc.identifier.doi | 10.1007/s10055-023-00761-8 | - |
dc.identifier.scopusid | 2-s2.0-85147771464 | - |
dc.identifier.wosid | 000932543100001 | - |
dc.identifier.bibliographicCitation | VIRTUAL REALITY, v.27, no.3, pp.1685 - 1696 | - |
dc.relation.isPartOf | VIRTUAL REALITY | - |
dc.citation.title | VIRTUAL REALITY | - |
dc.citation.volume | 27 | - |
dc.citation.number | 3 | - |
dc.citation.startPage | 1685 | - |
dc.citation.endPage | 1696 | - |
dc.type.rims | ART | - |
dc.type.docType | Article; Early Access | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Imaging Science & Photographic Technology | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Interdisciplinary Applications | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Software Engineering | - |
dc.relation.journalWebOfScienceCategory | Imaging Science & Photographic Technology | - |
dc.subject.keywordPlus | VIRTUAL-REALITY | - |
dc.subject.keywordPlus | CLASSIFICATION | - |
dc.subject.keywordPlus | INTERFACES | - |
dc.subject.keywordPlus | SYSTEMS | - |
dc.subject.keywordAuthor | Covariate shift adaptation | - |
dc.subject.keywordAuthor | Electromyogram | - |
dc.subject.keywordAuthor | Electrode shift | - |
dc.subject.keywordAuthor | Facial expression recognition | - |
dc.subject.keywordAuthor | Human-machine interface | - |
dc.subject.keywordAuthor | Virtual reality | - |
dc.identifier.url | https://link.springer.com/article/10.1007/s10055-023-00761-8 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.