See, caption, cluster: Large-scale image analysis using captioning and topic modeling
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kang, KyeongPil | - |
dc.contributor.author | Jin, Kyohoon | - |
dc.contributor.author | Jang, Soojin | - |
dc.contributor.author | Choo, Jaegul | - |
dc.contributor.author | Kim, Youngbin | - |
dc.date.accessioned | 2023-11-02T02:18:18Z | - |
dc.date.available | 2023-11-02T02:18:18Z | - |
dc.date.issued | 2024-03 | - |
dc.identifier.issn | 0957-4174 | - |
dc.identifier.issn | 1873-6793 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/68331 | - |
dc.description.abstract | Owing to the widespread use of smartphones and mobile devices and the prevalence of image-sharing social network services, the amount of image data available on the Web is soaring. Various tasks, such as image classification, detection, and segmentation, use tremendous amounts of image data to train machine learning models. Using these trained models, a visual feature representation vector can be extracted from individual images and subsequently be used in several applications, such as image retrieval, object detection, and clustering. However, despite the increasing demand for such analyses, few studies have analyzed the information summarized by such image datasets, especially for extracting topics, trends, and opinions from images generated by online communities. Therefore, we propose a novel approach to image topic modeling, which accounts for visual content as well as semantic information by leveraging the image captioning model. In addition, we propose an image–caption scoring model that measures the semantic similarity between an image and its generated caption in order to filter noisy data that obstruct analysis by obscuring the semantic meaning of topics extracted from the dataset. The results show that our proposed method assists in analyzing large-scale image datasets without the need to manually check individual images. Further experimental results show that our methods are particularly beneficial for applications such as data visualization, image retrieval, and image tag recommendation in the realm of large-scale image dataset analysis. © 2023 Elsevier Ltd | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Elsevier Ltd | - |
dc.title | See, caption, cluster: Large-scale image analysis using captioning and topic modeling | - |
dc.type | Article | - |
dc.identifier.doi | 10.1016/j.eswa.2023.121391 | - |
dc.identifier.bibliographicCitation | Expert Systems with Applications, v.237 | - |
dc.description.isOpenAccess | N | - |
dc.identifier.wosid | 001081904400001 | - |
dc.identifier.scopusid | 2-s2.0-85171834377 | - |
dc.citation.title | Expert Systems with Applications | - |
dc.citation.volume | 237 | - |
dc.type.docType | Article | - |
dc.publisher.location | 영국 | - |
dc.subject.keywordAuthor | Clustering | - |
dc.subject.keywordAuthor | Deep learning | - |
dc.subject.keywordAuthor | Image captioning | - |
dc.subject.keywordAuthor | Topic modeling | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Operations Research & Management Science | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Artificial Intelligence | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Operations Research & Management Science | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.