Facial electromyogram-based facial gesture recognition for hands-free control of an AR/VR environment: optimal gesture set selection and validation of feasibility as an assistive technology
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, Chunghwan | - |
dc.contributor.author | Kim, Chaeyoon | - |
dc.contributor.author | Kim, HyunSub | - |
dc.contributor.author | Kwak, HwyKuen | - |
dc.contributor.author | Lee, WooJin | - |
dc.contributor.author | Im, Chang-Hwan | - |
dc.date.accessioned | 2023-11-14T01:30:47Z | - |
dc.date.available | 2023-11-14T01:30:47Z | - |
dc.date.created | 2023-05-03 | - |
dc.date.issued | 2023-08 | - |
dc.identifier.issn | 2093-9868 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/192046 | - |
dc.description.abstract | The rapid expansion of virtual reality (VR) and augmented reality (AR) into various applications has increased the demand for hands-free input interfaces when traditional control methods are inapplicable (e.g., for paralyzed individuals who cannot move their hands). Facial electromyogram (fEMG), bioelectric signals generated from facial muscles, could solve this problem. Discriminating facial gestures using fEMG is possible because fEMG signals vary with these gestures. Thus, these signals can be used to generate discrete hands-free control commands. This study implemented an fEMG-based facial gesture recognition system for generating discrete commands to control an AR or VR environment. The fEMG signals around the eyes were recorded, assuming that the fEMG electrodes were embedded into the VR head-mounted display (HMD). Sixteen discrete facial gestures were classified using linear discriminant analysis (LDA) with Riemannian geometry features. Because the fEMG electrodes were far from the facial muscles associated with the facial gestures, some similar facial gestures were indistinguishable from each other. Therefore, this study determined the best facial gesture combinations with the highest classification accuracy for 3-15 commands. An analysis of the fEMG data acquired from 15 participants showed that the optimal facial gesture combinations increased the accuracy by 4.7%p compared with randomly selected facial gesture combinations. Moreover, this study is the first to investigate the feasibility of implementing a subject-independent facial gesture recognition system that does not require individual user training sessions. Lastly, our online hands-free control system was successfully applied to a media player to demonstrate the applicability of the proposed system. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | SPRINGERNATURE | - |
dc.title | Facial electromyogram-based facial gesture recognition for hands-free control of an AR/VR environment: optimal gesture set selection and validation of feasibility as an assistive technology | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Im, Chang-Hwan | - |
dc.identifier.doi | 10.1007/s13534-023-00277-9 | - |
dc.identifier.scopusid | 2-s2.0-85152442823 | - |
dc.identifier.wosid | 000967896700001 | - |
dc.identifier.bibliographicCitation | BIOMEDICAL ENGINEERING LETTERS, v.13, no.SI 3, pp.465 - 473 | - |
dc.relation.isPartOf | BIOMEDICAL ENGINEERING LETTERS | - |
dc.citation.title | BIOMEDICAL ENGINEERING LETTERS | - |
dc.citation.volume | 13 | - |
dc.citation.number | SI 3 | - |
dc.citation.startPage | 465 | - |
dc.citation.endPage | 473 | - |
dc.type.rims | ART | - |
dc.type.docType | Article; Early Access | - |
dc.identifier.kciid | ART002997471 | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.description.journalRegisteredClass | kci | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalWebOfScienceCategory | Engineering, Biomedical | - |
dc.subject.keywordPlus | HUMAN-MACHINE INTERFACE | - |
dc.subject.keywordPlus | CLASSIFICATION | - |
dc.subject.keywordPlus | EXPRESSIONS | - |
dc.subject.keywordAuthor | Facial electromyogram | - |
dc.subject.keywordAuthor | Facial expression | - |
dc.subject.keywordAuthor | Virtual reality | - |
dc.subject.keywordAuthor | Augmented reality | - |
dc.subject.keywordAuthor | Assistive device | - |
dc.identifier.url | https://link.springer.com/article/10.1007/s13534-023-00277-9 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.