RefCap: image captioning with referent objects attributes
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Park, Seokmok | - |
dc.contributor.author | Paik, Joonki | - |
dc.date.accessioned | 2024-01-23T02:00:21Z | - |
dc.date.available | 2024-01-23T02:00:21Z | - |
dc.date.issued | 2023-12 | - |
dc.identifier.issn | 2045-2322 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/71240 | - |
dc.description.abstract | In recent years, significant progress has been made in visual-linguistic multi-modality research, leading to advancements in visual comprehension and its applications in computer vision tasks. One fundamental task in visual-linguistic understanding is image captioning, which involves generating human-understandable textual descriptions given an input image. This paper introduces a referring expression image captioning model that incorporates the supervision of interesting objects. Our model utilizes user-specified object keywords as a prefix to generate specific captions that are relevant to the target object. The model consists of three modules including: (i) visual grounding, (ii) referring object selection, and (iii) image captioning modules. To evaluate its performance, we conducted experiments on the RefCOCO and COCO captioning datasets. The experimental results demonstrate that our proposed method effectively generates meaningful captions aligned with users’ specific interests. © 2023, The Author(s). | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Nature Research | - |
dc.title | RefCap: image captioning with referent objects attributes | - |
dc.type | Article | - |
dc.identifier.doi | 10.1038/s41598-023-48916-6 | - |
dc.identifier.bibliographicCitation | Scientific Reports, v.13, no.1 | - |
dc.description.isOpenAccess | Y | - |
dc.identifier.wosid | 001142614900042 | - |
dc.identifier.scopusid | 2-s2.0-85178945681 | - |
dc.citation.number | 1 | - |
dc.citation.title | Scientific Reports | - |
dc.citation.volume | 13 | - |
dc.type.docType | Article | - |
dc.publisher.location | 영국 | - |
dc.relation.journalResearchArea | Science & Technology - Other Topics | - |
dc.relation.journalWebOfScienceCategory | Multidisciplinary Sciences | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.