MediaPipe's Landmarks with RNN for Dynamic Sign Language Recognition
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Samaan, Gerges H. | - |
dc.contributor.author | Wadie, Abanoub R. | - |
dc.contributor.author | Attia, Abanoub K. | - |
dc.contributor.author | Asaad, Abanoub M. | - |
dc.contributor.author | Kamel, Andrew E. | - |
dc.contributor.author | Slim, Salwa O. | - |
dc.contributor.author | Abdallah, Mohamed S. | - |
dc.contributor.author | Cho, Young-Im | - |
dc.date.accessioned | 2022-11-11T07:40:28Z | - |
dc.date.available | 2022-11-11T07:40:28Z | - |
dc.date.created | 2022-11-08 | - |
dc.date.issued | 2022-10 | - |
dc.identifier.issn | 2079-9292 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/86029 | - |
dc.description.abstract | Communication for hearing-impaired communities is an exceedingly challenging task, which is why dynamic sign language was developed. Hand gestures and body movements are used to represent vocabulary in dynamic sign language. However, dynamic sign language faces some challenges, such as recognizing complicated hand gestures and low recognition accuracy, in addition to each vocabulary's reliance on a series of frames. This paper used MediaPipe in conjunction with RNN models to address dynamic sign language recognition issues. MediaPipe was used to determine the location, shape, and orientation by extracting keypoints of the hands, body, and face. RNN models such as GRU, LSTM, and Bi-directional LSTM address the issue of frame dependency in sign movement. Due to the lack of video-based datasets for sign language, the DSL10-Dataset was created. DSL10-Dataset contains ten vocabularies that were repeated 75 times by five signers providing the guiding steps for creating such one. Two experiments are carried out on our dataset (DSL10-Dataset) using RNN models to compare the accuracy of dynamic sign language recognition with and without the use of face keypoints. Experiments revealed that our model had an accuracy of more than 99%. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | MDPI | - |
dc.relation.isPartOf | ELECTRONICS | - |
dc.title | MediaPipe's Landmarks with RNN for Dynamic Sign Language Recognition | - |
dc.type | Article | - |
dc.type.rims | ART | - |
dc.description.journalClass | 1 | - |
dc.identifier.wosid | 000866898600001 | - |
dc.identifier.doi | 10.3390/electronics11193228 | - |
dc.identifier.bibliographicCitation | ELECTRONICS, v.11, no.19 | - |
dc.description.isOpenAccess | Y | - |
dc.identifier.scopusid | 2-s2.0-85139858456 | - |
dc.citation.title | ELECTRONICS | - |
dc.citation.volume | 11 | - |
dc.citation.number | 19 | - |
dc.contributor.affiliatedAuthor | Abdallah, Mohamed S. | - |
dc.contributor.affiliatedAuthor | Cho, Young-Im | - |
dc.type.docType | Article | - |
dc.subject.keywordAuthor | dynamic sign language (DSL) | - |
dc.subject.keywordAuthor | MediaPipe | - |
dc.subject.keywordAuthor | landmarks | - |
dc.subject.keywordAuthor | GRU | - |
dc.subject.keywordAuthor | LSTM | - |
dc.subject.keywordAuthor | BILSTM | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Physics | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Physics, Applied | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
1342, Seongnam-daero, Sujeong-gu, Seongnam-si, Gyeonggi-do, Republic of Korea(13120)031-750-5114
COPYRIGHT 2020 Gachon University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.