Real-Time Recognition of Facial Expressions Using Facial Electromyograms Recorded Around the Eyes for Social Virtual Reality Applications
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Cha, Ho-Seung | - |
dc.contributor.author | Choi, Seong-Jun | - |
dc.contributor.author | Im, Chang-Hwan | - |
dc.date.accessioned | 2021-08-02T09:27:40Z | - |
dc.date.available | 2021-08-02T09:27:40Z | - |
dc.date.created | 2021-05-12 | - |
dc.date.issued | 2020-05 | - |
dc.identifier.issn | 2169-3536 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/9815 | - |
dc.description.abstract | Recent developments of social virtual reality (VR) services using avatars have increased the need for facial expression recognition (FER) technology. FER systems are generally implemented using optical cameras; however, the performance of these systems can be limited when users are wearing head-mounted displays (HMDs) as users'faces are largely covered by the HMDs. Facial electromyograms (fEMGs) that can be recorded around users' eyes can be potentially used for implementing FER systems for VR applications. However, this technology lacks practicality owing to the need for large-scale training datasets; furthermore, it is hampered by a relatively low performance. In this study, we proposed an fEMG-based FER system based on the Riemannian manifold-based approach to reduce the number of training datasets needed and enhance FER performance. Our experiments with 42 participants showed an average classification accuracy as high as 85.01% for recognizing 11 facial expressions with only a single training dataset for each expression. We further developed an online FER system that could animate a virtual avatar's expression reflecting a user's facial expression in real time, thus demonstrating that our FER system can be potentially used for practical interactive VR applications, such as social VR networks, smart education, and virtual training. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC | - |
dc.title | Real-Time Recognition of Facial Expressions Using Facial Electromyograms Recorded Around the Eyes for Social Virtual Reality Applications | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Im, Chang-Hwan | - |
dc.identifier.doi | 10.1109/ACCESS.2020.2983608 | - |
dc.identifier.scopusid | 2-s2.0-85083444995 | - |
dc.identifier.wosid | 000528694500004 | - |
dc.identifier.bibliographicCitation | IEEE ACCESS, v.8, pp.62065 - 62075 | - |
dc.relation.isPartOf | IEEE ACCESS | - |
dc.citation.title | IEEE ACCESS | - |
dc.citation.volume | 8 | - |
dc.citation.startPage | 62065 | - |
dc.citation.endPage | 62075 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | Y | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Telecommunications | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Telecommunications | - |
dc.subject.keywordPlus | MYOELECTRIC CONTROL | - |
dc.subject.keywordPlus | ROBUST | - |
dc.subject.keywordAuthor | Facial expression recognition | - |
dc.subject.keywordAuthor | facial electromyography | - |
dc.subject.keywordAuthor | riemannian manifolds | - |
dc.subject.keywordAuthor | human-machine interface | - |
dc.subject.keywordAuthor | virtual reality | - |
dc.identifier.url | https://ieeexplore.ieee.org/document/9047852 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.