ST-CoNAL: Consistency-Based Acquisition Criterion Using Temporal Self-ensemble for Active Learning
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Baik, Jae Soon | - |
dc.contributor.author | Yoon, In Young | - |
dc.contributor.author | Choi, Jun Won | - |
dc.date.accessioned | 2023-05-03T09:40:36Z | - |
dc.date.available | 2023-05-03T09:40:36Z | - |
dc.date.created | 2023-04-06 | - |
dc.date.issued | 2023-02 | - |
dc.identifier.issn | 0302-9743 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/184855 | - |
dc.description.abstract | Modern deep learning has achieved great success in various fields. However, it requires the labeling of huge amounts of data, which is expensive and labor-intensive. Active learning (AL), which identifies the most informative samples to be labeled, is becoming increasingly important to maximize the efficiency of the training process. The existing AL methods mostly use only a single final fixed model for acquiring the samples to be labeled. This strategy may not be good enough in that the structural uncertainty of a model for given training data is not considered to acquire the samples. In this study, we propose a novel acquisition criterion based on temporal self-ensemble generated by conventional stochastic gradient descent (SGD) optimization. These self-ensemble models are obtained by capturing the intermediate network weights obtained through SGD iterations. Our acquisition function relies on a consistency measure between the student and teacher models. The student models are given a fixed number of temporal self-ensemble models, and the teacher model is constructed by averaging the weights of the student models. Using the proposed acquisition criterion, we present an AL algorithm, namely student-teacher consistency-based AL (ST-CoNAL). Experiments conducted for image classification tasks on CIFAR-10, CIFAR-100, Caltech-256, and Tiny ImageNet datasets demonstrate that the proposed ST-CoNAL achieves significantly better performance than the existing acquisition methods. Furthermore, extensive experiments show the robustness and effectiveness of our methods. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | Springer Science and Business Media Deutschland GmbH | - |
dc.title | ST-CoNAL: Consistency-Based Acquisition Criterion Using Temporal Self-ensemble for Active Learning | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Choi, Jun Won | - |
dc.identifier.doi | 10.1007/978-3-031-26351-4_30 | - |
dc.identifier.scopusid | 2-s2.0-85149956813 | - |
dc.identifier.bibliographicCitation | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), v.13846 LNCS, pp.493 - 509 | - |
dc.relation.isPartOf | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) | - |
dc.citation.title | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) | - |
dc.citation.volume | 13846 LNCS | - |
dc.citation.startPage | 493 | - |
dc.citation.endPage | 509 | - |
dc.type.rims | ART | - |
dc.type.docType | Conference Paper | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | scopus | - |
dc.subject.keywordPlus | Classification (of information) | - |
dc.subject.keywordPlus | Deep learning | - |
dc.subject.keywordPlus | Gradient methods | - |
dc.subject.keywordPlus | Stochastic systems | - |
dc.subject.keywordPlus | Students | - |
dc.subject.keywordPlus | Image classification | - |
dc.subject.keywordPlus | Active Learning | - |
dc.subject.keywordPlus | Consistency | - |
dc.subject.keywordPlus | Ensemble models | - |
dc.subject.keywordPlus | Images classification | - |
dc.subject.keywordPlus | Labelings | - |
dc.subject.keywordPlus | Stochastic gradient descent | - |
dc.subject.keywordPlus | Student Modeling | - |
dc.subject.keywordPlus | Student teachers | - |
dc.subject.keywordPlus | Teacher models | - |
dc.subject.keywordPlus | Temporal self-ensemble | - |
dc.subject.keywordAuthor | Active learning | - |
dc.subject.keywordAuthor | Consistency | - |
dc.subject.keywordAuthor | Image classification | - |
dc.subject.keywordAuthor | Temporal self-ensemble | - |
dc.identifier.url | https://link.springer.com/chapter/10.1007/978-3-031-26351-4_30 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.