Robust quantization of deep neural networks
- Authors
- Kim, Youngseok; Lee, Junyeol; Kim, Younghoon; Seo, Jiwon
- Issue Date
- Feb-2020
- Publisher
- Association for Computing Machinery, Inc
- Keywords
- Neural Network Quantization
- Citation
- CC 2020 - Proceedings of the 29th International Conference on Compiler Construction, pp.74 - 84
- Indexed
- SCIE
SCOPUS
- Journal Title
- CC 2020 - Proceedings of the 29th International Conference on Compiler Construction
- Start Page
- 74
- End Page
- 84
- URI
- https://scholarworks.bwise.kr/erica/handle/2021.sw.erica/1521
- DOI
- 10.1145/3377555.3377900
- Abstract
- We studied robust quantization of deep neural networks (DNNs) for embedded devices. Existing compression techniques often generate DNNs that are sensitive to external errors. Because embedded devices may be affected by external lights and outside weather, DNNs running on those devices must be robust to such errors. For robust quantization of DNNs, we formulate an optimization problem that finds the bit width for each layer minimizing the robustness loss. To efficiently find the solution, we design a dynamic programming based algorithm, called Qed. We also propose an incremental algorithm, Q∗ that quickly finds a reasonably robust quantization and then gradually improves it. We have evaluated Qed and Q∗ with three DNN models (LeNet, AlexNet, and VGG-16) and with Gaussian random errors and realistic errors. For comparison, we also evaluate universal quantization that uses equal bit width for all layers and Deep Compression, a weight-sharing based compression technique. When tested with increasing size of errors, Qed most robustly gives correct inference output. Even if a DNN is optimized for robustness, its quantizations may not be robust unless Qed is used. Moreover, we evaluate Q∗ for its trade off in execution time and robustness. In one tenth of Qed's execution time, Q∗ gives a quantization 98% as robust as the one by Qed. © 2020 Association for Computing Machinery.
- Files in This Item
-
Go to Link
- Appears in
Collections - COLLEGE OF COMPUTING > DEPARTMENT OF ARTIFICIAL INTELLIGENCE > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/erica/handle/2021.sw.erica/1521)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.