Unsupervised feature learning for self-tuning neural networks
- Authors
- Ryu, Jongbin; Yang, Ming-Hsuan; Lim, Jongwoo
- Issue Date
- Jan-2021
- Publisher
- PERGAMON-ELSEVIER SCIENCE LTD
- Keywords
- Self-tuning neural network; Unsupervised feature learning; Unsupervised transfer learning; Bagged clustering; Ranking violation for triplet sampling
- Citation
- NEURAL NETWORKS, v.133, pp.103 - 111
- Indexed
- SCIE
SCOPUS
- Journal Title
- NEURAL NETWORKS
- Volume
- 133
- Start Page
- 103
- End Page
- 111
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/142539
- DOI
- 10.1016/j.neunet.2020.10.011
- ISSN
- 0893-6080
- Abstract
- In recent years transfer learning has attracted much attention due to its ability to adapt a well trained model from one domain to another. Fine-tuning is one of the most widely-used methods which exploit a small set of labeled data in the target domain for adapting the network. Including a few methods using the labeled data in the source domain, most transfer learning methods require labeled datasets, and it restricts the use of transfer learning to new domains. In this paper, we propose a fully unsupervised self-tuning algorithm for learning visual features in different domains. The proposed method updates a pre-trained model by minimizing the triplet loss function using only unlabeled data in the target domain. First, we propose the relevance measure for unlabeled data by the bagged clustering method. Then triplets of the anchor, positive, and negative data points are sampled based on the ranking violations of the relevance scores and the Euclidean distances in the embedded feature space. This fully unsupervised self-tuning algorithm improves the performance of the network significantly. We extensively evaluate the proposed algorithm using various metrics, including classification accuracy, feature analysis, and clustering quality, on five benchmark datasets in different domains. Besides, we demonstrate that applying the self-tuning method on the fine-tuned network help achieve better results.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 컴퓨터소프트웨어학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/142539)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.