Self-supervised learning with automatic data augmentation for enhancing representation
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Park, Chanjong | - |
dc.contributor.author | Kim, Eunwoo | - |
dc.date.accessioned | 2024-07-25T12:00:35Z | - |
dc.date.available | 2024-07-25T12:00:35Z | - |
dc.date.issued | 2024-08 | - |
dc.identifier.issn | 0167-8655 | - |
dc.identifier.issn | 1872-7344 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/75185 | - |
dc.description.abstract | Self-supervised learning has become an increasingly popular method for learning effective representations from unlabeled data. One prominent approach in self-supervised learning is contrastive learning, which trains models to distinguish between similar and dissimilar sample pairs by pulling similar pairs closer and pushing dissimilar pairs farther apart. The key to the success of contrastive learning lies in the quality of the data augmentation, which increases the diversity of the data and helps the model learn more powerful and generalizable representations. While many studies have emphasized the importance of data augmentation, however, most of them rely on human-crafted augmentation strategies. In this paper, we propose a novel method, Self Augmentation on Contrastive Learning with Clustering (SACL), searching for the optimal data augmentation policy automatically using Bayesian optimization and clustering. The proposed approach overcomes the limitations of relying on domain knowledge and avoids the high costs associated with manually designing data augmentation rules. It automatically captures informative and useful features within the data by exploring augmentation policies. We demonstrate that the proposed method surpasses existing approaches that rely on manually designed augmentation rules. Our experiments show SACL outperforms manual strategies, achieving a performance improvement of 1.68% and 1.57% over MoCo v2 on the CIFAR10 and SVHN datasets, respectively. © 2024 Elsevier B.V. | - |
dc.format.extent | 7 | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Elsevier B.V. | - |
dc.title | Self-supervised learning with automatic data augmentation for enhancing representation | - |
dc.type | Article | - |
dc.identifier.doi | 10.1016/j.patrec.2024.06.012 | - |
dc.identifier.bibliographicCitation | Pattern Recognition Letters, v.184, pp 133 - 139 | - |
dc.description.isOpenAccess | N | - |
dc.identifier.wosid | 001262499200001 | - |
dc.identifier.scopusid | 2-s2.0-85196967475 | - |
dc.citation.endPage | 139 | - |
dc.citation.startPage | 133 | - |
dc.citation.title | Pattern Recognition Letters | - |
dc.citation.volume | 184 | - |
dc.type.docType | Article | - |
dc.publisher.location | 네델란드 | - |
dc.subject.keywordAuthor | Auto augmentation | - |
dc.subject.keywordAuthor | Clustering | - |
dc.subject.keywordAuthor | Contrastive learning | - |
dc.subject.keywordAuthor | Self-supervised learning | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Artificial Intelligence | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.