Regularizing Activation Distribution for Ultra Low-bit Quantization-Aware Training of MobileNets
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Park, Seongmin | - |
dc.contributor.author | Sung, Wonyong | - |
dc.contributor.author | Choi, Jungwook | - |
dc.date.accessioned | 2022-12-20T05:05:06Z | - |
dc.date.available | 2022-12-20T05:05:06Z | - |
dc.date.created | 2022-12-07 | - |
dc.date.issued | 2022-11 | - |
dc.identifier.issn | 1520-6130 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/172850 | - |
dc.description.abstract | MobileNets are a family of CNN architectures that are designed for parameter efficient model deployment. However, quantization aware training (QAT) of MobileNets for lowprecision model development has not been very successful partly due to the parameter efficient nature of the model. The activation signal in MobileNet shows fairly large magnitude diversity for each channel, which can lead to poor quantization results. We address this issue by including a new loss term for QAT, which regularizes the diversity of the activation signal in each channel. The proposed method improves the accuracy of the state-of-theart QAT when evaluated on MobileNet with CIFAR10/100, and ImageNet datasets. © 2022 IEEE. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | Institute of Electrical and Electronics Engineers Inc. | - |
dc.title | Regularizing Activation Distribution for Ultra Low-bit Quantization-Aware Training of MobileNets | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Choi, Jungwook | - |
dc.identifier.doi | 10.1109/SiPS55645.2022.9919240 | - |
dc.identifier.scopusid | 2-s2.0-85141799765 | - |
dc.identifier.wosid | 001081960800024 | - |
dc.identifier.bibliographicCitation | IEEE Workshop on Signal Processing Systems, SiPS: Design and Implementation, v.2022-November, pp.1 - 6 | - |
dc.relation.isPartOf | IEEE Workshop on Signal Processing Systems, SiPS: Design and Implementation | - |
dc.citation.title | IEEE Workshop on Signal Processing Systems, SiPS: Design and Implementation | - |
dc.citation.volume | 2022-November | - |
dc.citation.startPage | 1 | - |
dc.citation.endPage | 6 | - |
dc.type.rims | ART | - |
dc.type.docType | Proceedings Paper | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Telecommunications | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Telecommunications | - |
dc.subject.keywordPlus | Computer vision | - |
dc.subject.keywordPlus | Image enhancement | - |
dc.subject.keywordPlus | Quantization (signal) | - |
dc.subject.keywordPlus | Chemical activation | - |
dc.subject.keywordPlus | Activation distribution | - |
dc.subject.keywordPlus | Mobilenet | - |
dc.subject.keywordPlus | Model development | - |
dc.subject.keywordPlus | Quantisation | - |
dc.subject.keywordPlus | Quantization-aware training | - |
dc.subject.keywordAuthor | CNN | - |
dc.subject.keywordAuthor | MobileNet | - |
dc.subject.keywordAuthor | Quantization-aware training | - |
dc.identifier.url | https://ieeexplore.ieee.org/document/9919240 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.