Design and Investigation of Capsule Networks for Sentence Classification
- Authors
- Fentaw, Haftu Wedajo; Kim, Tae-Hyong
- Issue Date
- 1-Jun-2019
- Publisher
- MDPI
- Keywords
- deep learning; capsule networks; sentence classification; sentiment analysis
- Citation
- APPLIED SCIENCES-BASEL, v.9, no.11
- Journal Title
- APPLIED SCIENCES-BASEL
- Volume
- 9
- Number
- 11
- URI
- https://scholarworks.bwise.kr/kumoh/handle/2020.sw.kumoh/28199
- DOI
- 10.3390/app9112200
- ISSN
- 2076-3417
2076-3417
- Abstract
- In recent years, convolutional neural networks (CNNs) have been used as an alternative to recurrent neural networks (RNNs) in text processing with promising results. In this paper, we investigated the newly introduced capsule networks (CapsNets), which are getting a lot of attention due to their great performance gains on image analysis more than CNNs, for sentence classification or sentiment analysis in some cases. The results of our experiment show that the proposed well-tuned CapsNet model can be a good, sometimes better and cheaper, substitute of models based on CNNs and RNNs used in sentence classification. In order to investigate whether CapsNets can learn the sequential order of words or not, we performed a number of experiments by reshuffling the test data. Our CapsNet model shows an overall better classification performance and better resistance to adversarial attacks than CNN and RNN models.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - ETC > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.