Joint optimization of neural acoustic beamforming and dereverberation with x-vectors for robust speaker verification
- Authors
- Yang, Joon-Young; Chang, Joon Hyuk
- Issue Date
- Sep-2019
- Publisher
- International Speech Communication Association
- Keywords
- Acoustic beamforming; Deep neural network; Dereverberation; Joint training; Speaker verification
- Citation
- Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, v.2019, no.September, pp.4075 - 4079
- Indexed
- SCOPUS
- Journal Title
- Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
- Volume
- 2019
- Number
- September
- Start Page
- 4075
- End Page
- 4079
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/3801
- DOI
- 10.21437/Interspeech.2019-1356
- ISSN
- 2308-457X
- Abstract
- In this paper, we investigate the deep neural network (DNN) supported acoustic beamforming and dereverberation as the front-end of the x-vector speaker verification (SV) framework in a noisy and reverberant environment. Firstly, a DNN for supporting either the classical beamforming (e.g. MVDR) or the dereverberation (e.g. WPE) algorithm is trained on multi-channel speech signals. Next, an x-vector speaker embedding network is trained on top of the enhanced speech features to classify the training speakers. Finally, after the separate training stages are over, either one or both of the DNN supported beamforming and dereverberation modules are serially connected to the x-vector network, and jointly trained to optimize the common objective of speaker classification. Experiments on the artificially generated speech dataset using simulated and real room impulse responses (RIRs) with various types of domestic noise samples show that jointly training the supportive neural network models along with the x-vector network within the classical speech enhancement framework brings significant performance gain for robust text-independent (TI) SV.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 융합전자공학부 > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.