I Have No Text in My Post: Using Visual Hints to Model User Emotions in Social Media
- Authors
- Song, Junho; Han, Kyungsik; Kim, Sang-Wook
- Issue Date
- Apr-2022
- Publisher
- Association for Computing Machinery, Inc
- Keywords
- Emotion analysis; social media images; visual hints
- Citation
- WWW 2022 - Proceedings of the ACM Web Conference 2022, pp.2888 - 2896
- Indexed
- SCOPUS
- Journal Title
- WWW 2022 - Proceedings of the ACM Web Conference 2022
- Start Page
- 2888
- End Page
- 2896
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/138795
- DOI
- 10.1145/3485447.3512009
- ISSN
- 0000-0000
- Abstract
- As an emotion plays an important role in people's everyday lives and is often mirrored in their social media use, extensive research has been conducted to characterize and model emotions from social media data. However, prior research has not sufficiently considered trends of social media use - the increasing use of images and the decreasing use of text - nor identified the features of images in social media that are likely to be different from those in non-social media. Our study aims to fill this gap by (1) considering the notion of visual hints that depict contextual information of images, (2) presenting their characteristics in positive or negative emotions, and (3) demonstrating their effectiveness in emotion prediction modeling through an in-depth analysis of their relationship with the text in the same posts. The results of our experiments showed that our visual hint-based model achieved 20% improvement in emotion prediction, compared with the baseline. In particular, the performance of our model was comparable with that of the text-based model, highlighting not only a strong relationship between visual hints of the image and emotion, but also the potential of using only images for emotion prediction which well reflects current and future trends of social media use.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 컴퓨터소프트웨어학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/138795)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.