Mordo: Silent Command Recognition Through Lightweight Around-Ear Biosensors
- Authors
- Yi, C.; Wei, B.; Zhu, J.; Rho, Seungmin; Chen, Z.; Jiang, F.
- Issue Date
- Jan-2023
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- Ear; EMG signals; Face recognition; Headphones; Micro-interaction; Muscles; Sensors; Silent command recognition; Speech recognition; Task analysis
- Citation
- IEEE Internet of Things Journal, v.10, no.1, pp 763 - 773
- Pages
- 11
- Journal Title
- IEEE Internet of Things Journal
- Volume
- 10
- Number
- 1
- Start Page
- 763
- End Page
- 773
- URI
- https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/61116
- DOI
- 10.1109/JIOT.2022.3204336
- ISSN
- 2327-4662
- Abstract
- The prevalence of smart devices encourages increasing requirements of wearable human-computer interactions. To improve user acceptance, such interactions require easy-to-manipulate and unobtrusive characteristics. In this paper, we for the first time propose to recognize silent commands through a lightweight and around-ear biosensing system Mordo that can be easily integrated with earphones, manipulate smart devices and minimize social awkwardness. In particular, we first determine the empirical principles of constructing commands and experimentally screen the commands based on the around-ear configuration. Second, we select the optimal around-ear sensor configuration according to the single-channel SNRs and classification accuracies. Third, we propose a multi-stream CNN-LSTM network to learn the spatio-temporal mapping between the around-ear signals and commands. Finally, extensive experiments have been conducted to evaluate the feasibility and stability. The results indicate an averaged accuracy of 89.66% that outperforms other algorithms of similar tasks. The stability tests show that our system presents sufficient stability under command deformations and head motions. We demonstrate the necessity of collecting such scale of data by gradually reducing training data size. We also validate the generalization ability of our method toward other sensing parameters by reducing the spatial and temporal resolutions. The proof-of-concept design will aim the further development of the commercial products for silent command recognition (Demohttps://youtu.be/b-knN3Ry0H4 and https://youtu.be/BlPaM7PhEzQ). IEEE
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Business & Economics > Department of Industrial Security > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/61116)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.