Smart Glass System Using Deep Learning for the Blind and Visually Impaired
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Mukhiddinov, M. | - |
dc.contributor.author | Cho, Jinsoo | - |
dc.date.accessioned | 2022-06-02T02:40:12Z | - |
dc.date.available | 2022-06-02T02:40:12Z | - |
dc.date.created | 2021-11-17 | - |
dc.date.issued | 2021-11 | - |
dc.identifier.issn | 2079-9292 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/84476 | - |
dc.description.abstract | Individuals suffering from visual impairments and blindness encounter difficulties in moving independently and overcoming various problems in their routine lives. As a solution, artificial intelligence and computer vision approaches facilitate blind and visually impaired (BVI) people in fulfilling their primary activities without much dependency on other people. Smart glasses are a potential assistive technology for BVI people to aid in individual travel and provide social comfort and safety. However, practically, the BVI are unable move alone, particularly in dark scenes and at night. In this study we propose a smart glass system for BVI people, employing computer vision techniques and deep learning models, audio feedback, and tactile graphics to facilitate independent movement in a night-time environment. The system is divided into four models: a low-light image enhancement model, an object recognition and audio feedback model, a salient object detection model, and a text-to-speech and tactile graphics generation model. Thus, this system was developed to assist in the following manner: (1) enhancing the contrast of images under low-light conditions employing a two-branch exposure-fusion network; (2) guiding users with audio feedback using a transformer encoder–decoder object detection model that can recognize 133 categories of sound, such as people, animals, cars, etc., and (3) accessing visual information using salient object extraction, text recognition, and refreshable tactile display. We evaluated the performance of the system and achieved competitive performance on the challenging Low-Light and ExDark datasets. © 2021 by the authors. Licensee MDPI, Basel, Switzerland. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | MDPI | - |
dc.relation.isPartOf | Electronics | - |
dc.title | Smart Glass System Using Deep Learning for the Blind and Visually Impaired | - |
dc.type | Article | - |
dc.type.rims | ART | - |
dc.description.journalClass | 1 | - |
dc.identifier.wosid | 000797965400001 | - |
dc.identifier.doi | 10.3390/electronics10222756 | - |
dc.identifier.bibliographicCitation | Electronics, v.10, no.22 | - |
dc.description.isOpenAccess | N | - |
dc.identifier.scopusid | 2-s2.0-85118716667 | - |
dc.citation.title | Electronics | - |
dc.citation.volume | 10 | - |
dc.citation.number | 22 | - |
dc.contributor.affiliatedAuthor | Mukhiddinov, M. | - |
dc.contributor.affiliatedAuthor | Cho, Jinsoo | - |
dc.type.docType | Article | - |
dc.subject.keywordAuthor | Artificial intelligence | - |
dc.subject.keywordAuthor | Assistive technologies | - |
dc.subject.keywordAuthor | Blind and visually impaired | - |
dc.subject.keywordAuthor | Deep learning | - |
dc.subject.keywordAuthor | Low-light images | - |
dc.subject.keywordAuthor | Object detection | - |
dc.subject.keywordAuthor | Refreshable tactile display | - |
dc.subject.keywordAuthor | Smart glasses | - |
dc.subject.keywordPlus | OUTDOOR NAVIGATION SYSTEM | - |
dc.subject.keywordPlus | RECOGNITION SYSTEM | - |
dc.subject.keywordPlus | NEURAL-NETWORK | - |
dc.subject.keywordPlus | INDOOR | - |
dc.subject.keywordPlus | DESIGN | - |
dc.subject.keywordPlus | PEOPLE | - |
dc.subject.keywordPlus | AID | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Physics | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Physics, Applied | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
1342, Seongnam-daero, Sujeong-gu, Seongnam-si, Gyeonggi-do, Republic of Korea(13120)031-750-5114
COPYRIGHT 2020 Gachon University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.