Hardware and Software Co-optimization for the Initialization Failure of the ReRAM-based Cross-bar Array
- Authors
- Kim, Youngseok; Kim, Seyoung; Yeh, Chun-Chen; Narayanan, Vijay; Choi, Jungwook
- Issue Date
- Oct-2020
- Publisher
- ASSOC COMPUTING MACHINERY
- Keywords
- Inference; accelerator; neural networks; ReRAM
- Citation
- ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS, v.16, no.4, pp.1 - 18
- Indexed
- SCIE
SCOPUS
- Journal Title
- ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS
- Volume
- 16
- Number
- 4
- Start Page
- 1
- End Page
- 18
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/8917
- DOI
- 10.1145/3393669
- ISSN
- 1550-4832
- Abstract
- Recent advances in deep neural network demand more than millions of parameters to handle and mandate the high-performance computing resources with improved efficiency. The cross-bar array architecture has been considered as one of the promising deep learning architectures that shows a significant computing gain over the conventional processors. To investigate the feasibility of the architecture, we examine non-idealities and their impact on the performance. Specifically, we study the impact of failed cells due to the initialization process of the resistive memory-based cross-bar array. Unlike the conventional memory array, individual memory elements cannot be rerouted and, thus, may have a critical impact on model accuracy. We categorize the possible failures and propose hardware implementation that minimizes catastrophic failures. Such hardware optimization bounds the possible logical value of the failed cells and allows us to compensate for the loss of accuracy via off-line training. By introducing the random weight defects during the training, we show that the model becomes more resilient on the device initialization failures, therefore, less prone to degrade the inference performance due to the failed devices. Our study sheds light on the hardware and software co-optimization procedure to cope with potentially catastrophic failures in the cross-bar array.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 융합전자공학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/8917)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.