MixER: Mixup-based Experience Replay for Online Class-Incremental Learning
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Lim, Won-Seon | - |
dc.contributor.author | Zhou, Yu | - |
dc.contributor.author | Kim, Dae-Won | - |
dc.contributor.author | Lee, Jaesung | - |
dc.date.accessioned | 2024-04-11T11:30:57Z | - |
dc.date.available | 2024-04-11T11:30:57Z | - |
dc.date.issued | 2024-03 | - |
dc.identifier.issn | 2169-3536 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/73165 | - |
dc.description.abstract | Continual learning in the online class-incremental setting aims to learn new classes continuously from a consistent data stream while retaining the knowledge of old classes to prevent catastrophic forgetting. Traditional replay-based methods store and use old-class data to achieve this. However, they often overlook the representation shift caused by the incoming data streams, which leads to suboptimal classification accuracy. In this study, we propose a solution for mitigating representation shifts by incorporating asymmetric mixup training into the replay method. Our approach is based on the concept that mixup-based training enhances the stability of model predictions and gradient norms between training samples. Our method differs from typical mixup augmentation, which is uniformly applied to all data. Instead, it selectively targets the old data stored in the memory buffer, deliberately excluding the classes from the newly incoming data. This approach enables the model to learn new data while preserving the representation of the old data. Moreover, our experiments demonstrate the effectiveness of the proposed method, which not only enhances the performance of replay-based methods but can also be seamlessly integrated as an additional compatible module into various replay-based techniques. Evaluation on the CIFAR-10, CIFAR-100, and Tiny-ImageNet datasets demonstrates that our approach surpasses existing replay-based methods. It addresses the limitations of conventional replay techniques and offers a potential solution for continual learning scenarios. Our source code is publicly available at https://github.com/laymond1/MixER. Authors | - |
dc.format.extent | 14 | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Institute of Electrical and Electronics Engineers Inc. | - |
dc.title | MixER: Mixup-based Experience Replay for Online Class-Incremental Learning | - |
dc.type | Article | - |
dc.identifier.doi | 10.1109/ACCESS.2024.3378606 | - |
dc.identifier.bibliographicCitation | IEEE Access, v.12, pp 41801 - 41814 | - |
dc.description.isOpenAccess | Y | - |
dc.identifier.wosid | 001192203000001 | - |
dc.identifier.scopusid | 2-s2.0-85188457198 | - |
dc.citation.endPage | 41814 | - |
dc.citation.startPage | 41801 | - |
dc.citation.title | IEEE Access | - |
dc.citation.volume | 12 | - |
dc.type.docType | Article | - |
dc.publisher.location | 미국 | - |
dc.subject.keywordAuthor | Adaptation models | - |
dc.subject.keywordAuthor | Continual Learning | - |
dc.subject.keywordAuthor | Data models | - |
dc.subject.keywordAuthor | Learning systems | - |
dc.subject.keywordAuthor | Mixers | - |
dc.subject.keywordAuthor | Mixup Training | - |
dc.subject.keywordAuthor | Online Learning | - |
dc.subject.keywordAuthor | Predictive models | - |
dc.subject.keywordAuthor | Replay-based Learning | - |
dc.subject.keywordAuthor | Task analysis | - |
dc.subject.keywordAuthor | Training | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Telecommunications | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Telecommunications | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.