BPLC + NOSO: backpropagation of errors based on latency code with neurons that only spike once at mostopen accessBPLC plus NOSO: backpropagation of errors based on latency code with neurons that only spike once at most
- Other Titles
- BPLC plus NOSO: backpropagation of errors based on latency code with neurons that only spike once at most
- Authors
- Jin, Seong Min; Kim, Dohun; Yoo, Dong Hyung; Eshraghian, Jason; Jeong, Doo Seok
- Issue Date
- Oct-2023
- Publisher
- SPRINGER HEIDELBERG
- Keywords
- Backpropagation based on latency code; Spiking neural networks; Minimum-latency pooling; Symmetric dual threshold
- Citation
- COMPLEX&INTELLIGENT SYSTEMS, v.9, no.5, pp.4959 - 4976
- Indexed
- SCIE
SCOPUS
- Journal Title
- COMPLEX&INTELLIGENT SYSTEMS
- Volume
- 9
- Number
- 5
- Start Page
- 4959
- End Page
- 4976
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/192064
- DOI
- 10.1007/s40747-023-00983-y
- ISSN
- 2199-4536
- Abstract
- For mathematical completeness, we propose an error-backpropagation algorithm based on latency code (BPLC) with spiking neurons conforming to the spike–response model but allowed to spike once at most (NOSOs). BPLC is based on gradients derived without approximation unlike previous temporal code-based error-backpropagation algorithms. The latency code uses the spiking latency (period from the first input spike to spiking) as a measure of neuronal activity. To support the latency code, we introduce a minimum-latency pooling layer that passes the spike of the minimum latency only for a given patch. We also introduce a symmetric dual threshold for spiking (i) to avoid the dead neuron issue and (ii) to confine a potential distribution to the range between the symmetric thresholds. Given that the number of spikes (rather than timesteps) is the major cause of inference delay for digital neuromorphic hardware, NOSONets trained using BPLC likely reduce inference delay significantly. To identify the feasibility of BPLC + NOSO, we trained CNN-based NOSONets on Fashion-MNIST and CIFAR-10. The classification accuracy on CIFAR-10 exceeds the state-of-the-art result from an SNN of the same depth and width by approximately 2%. Additionally, the number of spikes for inference is significantly reduced (by approximately one order of magnitude), highlighting a significant reduction in inference delay.
- Files in This Item
-
- Appears in
Collections - 서울 공과대학 > 서울 신소재공학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/192064)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.