DNN-based Speech Recognition System dealing with Motor State as Auxiliary Information of DNN for Head Shaking Robot
- Authors
- Lee, Moa; Chang, Joon Hyuk
- Issue Date
- Dec-2018
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Citation
- IEEE International Conference on Intelligent Robots and Systems, pp.1859 - 1863
- Indexed
- SCOPUS
- Journal Title
- IEEE International Conference on Intelligent Robots and Systems
- Start Page
- 1859
- End Page
- 1863
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/4644
- DOI
- 10.1109/IROS.2018.8593396
- ISSN
- 2153-0858
- Abstract
- In this paper, a deep neural network (DNN) based integrated background noise suppression and acoustic modeling for speech recognition proposed in which on/off state of the motor for the head shaking robot is employed as the relevant auxiliary information of the DNN input. Since the motor sound being generated when the robot is moving or shaking its head severely degrades the performance of the speech recognition accuracy, we propose to use the motor on/off state as additional information when designing the DNN-based recognition system. Our speech recognition algorithm consists of two parts including the feature mapping model for feature enhancement and the acoustic model for phoneme recognition. As for the feature mapping, the stacked DNN is designed for the precise feature enhancement such that the lower DNN and upper DNN are trained separately and combined after which the motor state is plugged into both the lower DNN and upper DNN in addition to the input noisy speech. Then, the acoustic model is trained upon the feature enhancement model in which the motor state is again used as the augmented feature. The proposed technique to suppress the acoustic and motor noises was evaluated in term of the phoneme error rate (PER) and showed a significant improvement over the conventional system.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 융합전자공학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/4644)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.