Log-quantization on GRU networks
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Park, Sang-Ki | - |
dc.contributor.author | Park, Sang-Soo | - |
dc.contributor.author | Chung, Ki Seok | - |
dc.date.accessioned | 2021-07-30T05:31:30Z | - |
dc.date.available | 2021-07-30T05:31:30Z | - |
dc.date.created | 2021-05-13 | - |
dc.date.issued | 2018-11 | - |
dc.identifier.issn | 0000-0000 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/5240 | - |
dc.description.abstract | Today, recurrent neural network (RNN) is used in various applications like image captioning, speech recognition and machine translation. However, because of data dependencies, recurrent neural network is hard to parallelize. Furthermore, to increase network’s accuracy, recurrent neural network uses complicated cell units such as long short-term memory (LSTM) and gated recurrent unit (GRU). To run such models on an embedded system, the size of the network model and the amount of computation need to be reduced to achieve low power consumption and low required memory bandwidth. In this paper, implementation of RNN based on GRU with a logarithmic quantization method is proposed. The proposed implementation is synthesized using high-level synthesis (HLS) targeting Xilinx ZCU102 FPGA running at 100MHz. The proposed implementation with an 8-bit log-quantization achieves 90.57% accuracy without re-training or fine-tuning. And the memory usage is 31% lower than that for an implementation with 32-bit floating point data representation. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | Association for Computing Machinery | - |
dc.title | Log-quantization on GRU networks | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Chung, Ki Seok | - |
dc.identifier.doi | 10.1145/3290420.3290443 | - |
dc.identifier.scopusid | 2-s2.0-85062772721 | - |
dc.identifier.bibliographicCitation | ACM International Conference Proceeding Series, pp.112 - 116 | - |
dc.relation.isPartOf | ACM International Conference Proceeding Series | - |
dc.citation.title | ACM International Conference Proceeding Series | - |
dc.citation.startPage | 112 | - |
dc.citation.endPage | 116 | - |
dc.type.rims | ART | - |
dc.type.docType | Conference Paper | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | scopus | - |
dc.subject.keywordPlus | Artificial intelligence | - |
dc.subject.keywordPlus | Digital arithmetic | - |
dc.subject.keywordPlus | Field programmable gate arrays (FPGA) | - |
dc.subject.keywordPlus | Hardware-software codesign | - |
dc.subject.keywordPlus | High level synthesis | - |
dc.subject.keywordPlus | Logic Synthesis | - |
dc.subject.keywordPlus | Low power electronics | - |
dc.subject.keywordPlus | Speech recognition | - |
dc.subject.keywordPlus | Speech transmission | - |
dc.subject.keywordPlus | Data dependencies | - |
dc.subject.keywordPlus | Floating-point data | - |
dc.subject.keywordPlus | HW/SW Codesign | - |
dc.subject.keywordPlus | LeNet-5 | - |
dc.subject.keywordPlus | Low-power consumption | - |
dc.subject.keywordPlus | Machine translations | - |
dc.subject.keywordPlus | Recurrent neural network (RNN) | - |
dc.subject.keywordPlus | SDSoC | - |
dc.subject.keywordPlus | Long short-term memory | - |
dc.subject.keywordAuthor | AI | - |
dc.subject.keywordAuthor | CNN | - |
dc.subject.keywordAuthor | FPGA | - |
dc.subject.keywordAuthor | HLS | - |
dc.subject.keywordAuthor | HW/SW Co-Design | - |
dc.subject.keywordAuthor | LeNet-5 | - |
dc.subject.keywordAuthor | SDSoC | - |
dc.identifier.url | https://dl.acm.org/doi/10.1145/3290420.3290443 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.