Investigation of DNN based feature enhancement jointly trained with x-vectors for noise-robust speaker verification

Abstract

In this paper, we investigate the deep neural network (DNN) based feature enhancement as the denoising frontend of the x-vector speaker verification framework in noisy environments. Firstly, the feature enhancement DNN (FE-DNN) learns the mapping function from the noisy to the clean corpora on the frame-level acoustic feature domain, and then the x-vector network (XvectorNet) is trained on top of the enhanced features. Finally, the separately trained FE-DNN and the XvectorNet are serially concatenated and jointly trained under the supervision of cross-entropy loss. In addition., we adopt the logistic margin softmax layer for training the XvectorNet in order to obtain more discriminative speaker embeddings.