Visual context embeddings for zero-shot recognition
- Authors
- Cho, Gunhee; Choi, Yong Suk
- Issue Date
- Apr-2022
- Publisher
- Association for Computing Machinery
- Keywords
- semantic embeddings; zero-shot learning; zero-shot recognition
- Citation
- Proceedings of the ACM Symposium on Applied Computing, pp.1039 - 1047
- Indexed
- SCOPUS
- Journal Title
- Proceedings of the ACM Symposium on Applied Computing
- Start Page
- 1039
- End Page
- 1047
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/138798
- DOI
- 10.1145/3477314.3507071
- ISSN
- 0000-0000
- Abstract
- Existing word-embeddings have performed well in various downstream tasks, but there may be a bias towards the text domain because they are learned from a text corpus. When word-embeddings are used in the Zero-Shot Recognition(ZSR) task, the task becomes a mapping problem between two completely different heterogeneous domains, a low-level visual feature domain, and a word embedding domain, and due to the bias of word-embeddings, it was not easy to learn this mapping function. However, if the context of the visual domain can be learned and embedded, the mapping function of ZSR will be much easier to converge because it only needs to learn the mapping between domains that are more correlated to each other. Therefore, in this paper, we propose a new methodology for embedding the context contained in the visual domain using the annotation information collected from the image dataset. In addition, to utilize the annotations collected from the image dataset for embedding, we proposed a new distance formula to measure the contextual distance between the bounding boxes of objects. Finally, it was verified through various experiments on two datasets that the embeddings learned by our new methodology performed well when applied to ZSR.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 컴퓨터소프트웨어학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/138798)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.