Unsupervised feature learning for self-tuning neural networks
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Ryu, Jongbin | - |
dc.contributor.author | Yang, Ming-Hsuan | - |
dc.contributor.author | Lim, Jongwoo | - |
dc.date.accessioned | 2022-07-07T01:45:00Z | - |
dc.date.available | 2022-07-07T01:45:00Z | - |
dc.date.created | 2021-05-11 | - |
dc.date.issued | 2021-01 | - |
dc.identifier.issn | 0893-6080 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/142539 | - |
dc.description.abstract | In recent years transfer learning has attracted much attention due to its ability to adapt a well trained model from one domain to another. Fine-tuning is one of the most widely-used methods which exploit a small set of labeled data in the target domain for adapting the network. Including a few methods using the labeled data in the source domain, most transfer learning methods require labeled datasets, and it restricts the use of transfer learning to new domains. In this paper, we propose a fully unsupervised self-tuning algorithm for learning visual features in different domains. The proposed method updates a pre-trained model by minimizing the triplet loss function using only unlabeled data in the target domain. First, we propose the relevance measure for unlabeled data by the bagged clustering method. Then triplets of the anchor, positive, and negative data points are sampled based on the ranking violations of the relevance scores and the Euclidean distances in the embedded feature space. This fully unsupervised self-tuning algorithm improves the performance of the network significantly. We extensively evaluate the proposed algorithm using various metrics, including classification accuracy, feature analysis, and clustering quality, on five benchmark datasets in different domains. Besides, we demonstrate that applying the self-tuning method on the fine-tuned network help achieve better results. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | PERGAMON-ELSEVIER SCIENCE LTD | - |
dc.title | Unsupervised feature learning for self-tuning neural networks | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Lim, Jongwoo | - |
dc.identifier.doi | 10.1016/j.neunet.2020.10.011 | - |
dc.identifier.scopusid | 2-s2.0-85095459252 | - |
dc.identifier.wosid | 000596613900011 | - |
dc.identifier.bibliographicCitation | NEURAL NETWORKS, v.133, pp.103 - 111 | - |
dc.relation.isPartOf | NEURAL NETWORKS | - |
dc.citation.title | NEURAL NETWORKS | - |
dc.citation.volume | 133 | - |
dc.citation.startPage | 103 | - |
dc.citation.endPage | 111 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Neurosciences & Neurology | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Artificial Intelligence | - |
dc.relation.journalWebOfScienceCategory | Neurosciences | - |
dc.subject.keywordPlus | IMAGE SIMILARITY | - |
dc.subject.keywordAuthor | Self-tuning neural network | - |
dc.subject.keywordAuthor | Unsupervised feature learning | - |
dc.subject.keywordAuthor | Unsupervised transfer learning | - |
dc.subject.keywordAuthor | Bagged clustering | - |
dc.subject.keywordAuthor | Ranking violation for triplet sampling | - |
dc.identifier.url | https://www.sciencedirect.com/science/article/pii/S089360802030366X?via%3Dihub | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.