Image-Text Sentiment Analysis Model Based on Visual Aspect Attention
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Daniel James | - |
dc.contributor.author | Lee, Seung Hyun | - |
dc.contributor.author | Lee, Won Hyung | - |
dc.date.accessioned | 2022-01-10T05:49:52Z | - |
dc.date.available | 2022-01-10T05:49:52Z | - |
dc.date.issued | 2021-12 | - |
dc.identifier.issn | 1976-6513 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/53116 | - |
dc.description.abstract | Social network has become an integral part of our daily life. Sentiment analysis of social media information is helpful to understand people's views, attitudes and emotions on social networking sites. Traditional sentiment analysis mainly relies on text. With the rise of smart phones, information on the network is gradually diversified, including not only text, but also images. It is found that, in many cases, images can enhance the text rather than express emotions independently. We propose a novel image text sentiment analysis model (LSTM-VAA). Specifically, this model does not take the picture information as the direct input, but uses the VGG16 network to extract the image features, and then generates the visual aspect attention, and gives the core sentences in the document a higher weight, and get a document representation based on the visual aspect attention. In addition, we use the LSTM network to extract the text sentiment and get the document representation based on text only. Finally, we fuse the two groups of classification results to obtain the final classification label. On the yelp restaurant reviews data set, our model achieves an accuracy of 62.08%, which is 18.92% higher than BiGRU-m VGG, which verifies the effectiveness of using visual information as aspect attention assisted text for emotion classification; It is 0.32% higher than Vista-Net model, which proves that LSTM model can effectively make up for the defect that images in Vista-Net model cannot completely cover text. | - |
dc.format.extent | 13 | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | (사)한국컴퓨터게임학회 | - |
dc.title | Image-Text Sentiment Analysis Model Based on Visual Aspect Attention | - |
dc.title.alternative | Image-Text Sentiment Analysis Model Based on Visual Aspect Attention | - |
dc.type | Article | - |
dc.identifier.doi | 10.22819/kscg.2021.34.4.013 | - |
dc.identifier.bibliographicCitation | 한국컴퓨터게임학회논문지, v.34, no.4, pp 125 - 137 | - |
dc.identifier.kciid | ART002791471 | - |
dc.description.isOpenAccess | N | - |
dc.citation.endPage | 137 | - |
dc.citation.number | 4 | - |
dc.citation.startPage | 125 | - |
dc.citation.title | 한국컴퓨터게임학회논문지 | - |
dc.citation.volume | 34 | - |
dc.publisher.location | 대한민국 | - |
dc.subject.keywordAuthor | Visual aspect attention | - |
dc.subject.keywordAuthor | LSTM | - |
dc.subject.keywordAuthor | Multi-model | - |
dc.subject.keywordAuthor | Sentiment analysis | - |
dc.subject.keywordAuthor | Social images | - |
dc.description.journalRegisteredClass | kci | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.