Multimodal priority verification of face and speech using momentum back-propagation neural network

Abstract

In this paper, we propose a priority verification method for multimodal biometric features by using a momentum back-propagation artificial neural network (MBP-ANN). We also propose a personal verification method using both face and speech to improve the rate of single biometric verification. False acceptance rate (FAR) and false rejection rate (FRR) have been a fundamental bottleneck of real-time personal verification. The proposed multimodal biometric method is to improve both verification rate and reliability in real-time by overcoming technical limitations of single biometric verification methods. The proposed method uses principal component analysis (PCA) for face recognition and hidden markov model (HMM) for speech recognition. It also uses MBP-ANN for the final decision of personal verification. Based on experimental results, the proposed system can reduce FAR down to 0.0001%, which proves that the proposed method overcomes the limitation of single biometric system and proves stable personal verification in real-time.