Enhancing Speech Emotion Recognition Using Dual Feature Extraction Encoders
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Pulatov, Ilkhomjon | - |
dc.contributor.author | Oteniyazov, Rashid | - |
dc.contributor.author | Makhmudov, Fazliddin | - |
dc.contributor.author | Cho, Young-Im | - |
dc.date.accessioned | 2023-08-28T01:42:22Z | - |
dc.date.available | 2023-08-28T01:42:22Z | - |
dc.date.created | 2023-08-25 | - |
dc.date.issued | 2023-07 | - |
dc.identifier.issn | 1424-8220 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/88904 | - |
dc.description.abstract | Understanding and identifying emotional cues in human speech is a crucial aspect of human-computer communication. The application of computer technology in dissecting and deciphering emotions, along with the extraction of relevant emotional characteristics from speech, forms a significant part of this process. The objective of this study was to architect an innovative framework for speech emotion recognition predicated on spectrograms and semantic feature transcribers, aiming to bolster performance precision by acknowledging the conspicuous inadequacies in extant methodologies and rectifying them. To procure invaluable attributes for speech detection, this investigation leveraged two divergent strategies. Primarily, a wholly convolutional neural network model was engaged to transcribe speech spectrograms. Subsequently, a cutting-edge Mel-frequency cepstral coefficient feature abstraction approach was adopted and integrated with Speech2Vec for semantic feature encoding. These dual forms of attributes underwent individual processing before they were channeled into a long short-term memory network and a comprehensive connected layer for supplementary representation. By doing so, we aimed to bolster the sophistication and efficacy of our speech emotion detection model, thereby enhancing its potential to accurately recognize and interpret emotion from human speech. The proposed mechanism underwent a rigorous evaluation process employing two distinct databases: RAVDESS and EMO-DB. The outcome displayed a predominant performance when juxtaposed with established models, registering an impressive accuracy of 94.8% on the RAVDESS dataset and a commendable 94.0% on the EMO-DB dataset. This superior performance underscores the efficacy of our innovative system in the realm of speech emotion recognition, as it outperforms current frameworks in accuracy metrics. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | MDPI | - |
dc.relation.isPartOf | SENSORS | - |
dc.title | Enhancing Speech Emotion Recognition Using Dual Feature Extraction Encoders | - |
dc.type | Article | - |
dc.type.rims | ART | - |
dc.description.journalClass | 1 | - |
dc.identifier.wosid | 001039064600001 | - |
dc.identifier.doi | 10.3390/s23146640 | - |
dc.identifier.bibliographicCitation | SENSORS, v.23, no.14 | - |
dc.description.isOpenAccess | Y | - |
dc.identifier.scopusid | 2-s2.0-85166019330 | - |
dc.citation.title | SENSORS | - |
dc.citation.volume | 23 | - |
dc.citation.number | 14 | - |
dc.contributor.affiliatedAuthor | Pulatov, Ilkhomjon | - |
dc.contributor.affiliatedAuthor | Makhmudov, Fazliddin | - |
dc.contributor.affiliatedAuthor | Cho, Young-Im | - |
dc.type.docType | Article | - |
dc.subject.keywordAuthor | speech emotion recognition | - |
dc.subject.keywordAuthor | CNN | - |
dc.subject.keywordAuthor | LSTM | - |
dc.subject.keywordAuthor | feature extraction | - |
dc.subject.keywordAuthor | MFCC | - |
dc.subject.keywordAuthor | spectrogram | - |
dc.subject.keywordPlus | DEEP | - |
dc.subject.keywordPlus | CLASSIFICATION | - |
dc.relation.journalResearchArea | Chemistry | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Instruments & Instrumentation | - |
dc.relation.journalWebOfScienceCategory | Chemistry, Analytical | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Instruments & Instrumentation | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
1342, Seongnam-daero, Sujeong-gu, Seongnam-si, Gyeonggi-do, Republic of Korea(13120)031-750-5114
COPYRIGHT 2020 Gachon University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.