Language of gleam: Impressionism artwork automatic caption generation for people with visual impairments
- Authors
- Lee, D.[Lee, D.]; KYOUNG, H. H.[KYOUNG, HWANG HYE]; Shahid, Jabbar M.[Shahid, Jabbar M.]; Cho, J.-D.[Cho, J.-D.]
- Issue Date
- 2021
- Publisher
- SPIE
- Keywords
- Deep learning; Human-centric artificial intelligence; Human-computer interaction; Image caption generation; Visual artwork
- Citation
- Proceedings of SPIE - The International Society for Optical Engineering, v.11605
- Indexed
- SCOPUS
- Journal Title
- Proceedings of SPIE - The International Society for Optical Engineering
- Volume
- 11605
- URI
- https://scholarworks.bwise.kr/skku/handle/2021.sw.skku/93814
- DOI
- 10.1117/12.2588331
- ISSN
- 0277-786X
- Abstract
- User Experience Design (UX Design) comes from focusing on how products, in reality, affect the user's experience. In particular, the design of multi-modal interfaces for blind people facilitates the flexible and natural product or service capacity and improves blind people's interaction by overcoming the various existing constraints associated with any particular interaction. There have been various attempts to help visually impaired people appreciation of visual artwork, including multi-modal associations. However, these methods can only provide general information in terms of edge and pattern recognition by the sense of touch and restrained by the availability and number of specially developed artworks. We propose a novel method explaining visual artworks through image caption generation using artificial intelligence (AI) to improve artwork accessibility. This method can objectively describe any impressionism artwork used as a standalone description of art interpretation for blind people or can aide tactile-based methods. Based on end-to-end learning with a deep neural network, an encoder-decoder architecture model is adopted, and comprehensive experiments perform to confirm the stability of generated image captioning for stylized MS-COCO datasets with impressionism. © 2021 SPIE.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Information and Communication Engineering > School of Electronic and Electrical Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.