Improving Adversarial Robustness via Distillation-Based Purification
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Koo, Inhwa | - |
dc.contributor.author | Chae, Dong-Kyu | - |
dc.contributor.author | Lee, Sang-Chul | - |
dc.date.accessioned | 2024-06-12T00:00:17Z | - |
dc.date.available | 2024-06-12T00:00:17Z | - |
dc.date.issued | 2023-10 | - |
dc.identifier.issn | 2076-3417 | - |
dc.identifier.issn | 2076-3417 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/194756 | - |
dc.description.abstract | Despite the impressive performance of deep neural networks on many different vision tasks, they have been known to be vulnerable to intentionally added noise to input images. To combat these adversarial examples (AEs), improving the adversarial robustness of models has emerged as an important research topic, and research has been conducted in various directions including adversarial training, image denoising, and adversarial purification. Among them, this paper focuses on adversarial purification, which is a kind of pre-processing that removes noise before AEs enter a classification model. The advantage of adversarial purification is that it can improve robustness without affecting the model's nature, while another defense techniques like adversarial training suffer from a decrease in model accuracy. Our proposed purification framework utilizes a Convolutional Autoencoder as a base model to capture the features of images and their spatial structure.We further aim to improve the adversarial robustness of our purification model by distilling the knowledge from teacher models. To this end, we train two Convolutional Autoencoders (teachers), one with adversarial training and the other with normal training. Then, through ensemble knowledge distillation, we transfer the ability of denoising and restoring of original images to the student model (purification model). Our extensive experiments confirm that our student model achieves high purification performance(i.e., how accurately a pre-trained classification model classifies purified images). The ablation study confirms the positive effect of our idea of ensemble knowledge distillation from two teachers on performance. | - |
dc.format.extent | 11 | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | MDPI | - |
dc.title | Improving Adversarial Robustness via Distillation-Based Purification | - |
dc.type | Article | - |
dc.publisher.location | 스위스 | - |
dc.identifier.doi | 10.3390/app132011313 | - |
dc.identifier.scopusid | 2-s2.0-85192464467 | - |
dc.identifier.wosid | 001119484700001 | - |
dc.identifier.bibliographicCitation | APPLIED SCIENCES-BASEL, v.13, no.20, pp 1 - 11 | - |
dc.citation.title | APPLIED SCIENCES-BASEL | - |
dc.citation.volume | 13 | - |
dc.citation.number | 20 | - |
dc.citation.startPage | 1 | - |
dc.citation.endPage | 11 | - |
dc.type.docType | Article | - |
dc.description.isOpenAccess | Y | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Chemistry | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Materials Science | - |
dc.relation.journalResearchArea | Physics | - |
dc.relation.journalWebOfScienceCategory | Chemistry, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Engineering, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Materials Science, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Physics, Applied | - |
dc.subject.keywordAuthor | adversarial robustness | - |
dc.subject.keywordAuthor | adversarial attacks | - |
dc.subject.keywordAuthor | adversarial purification | - |
dc.subject.keywordAuthor | knowledge distillation | - |
dc.subject.keywordAuthor | image classification | - |
dc.subject.keywordAuthor | convolutional autoencoders | - |
dc.identifier.url | https://www.mdpi.com/2076-3417/13/20/11313 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.