Rethinking ROUGE Scores for Video Game Review SummarizationRethinking ROUGE Scores for Video Game Review Summarization
- Other Titles
- Rethinking ROUGE Scores for Video Game Review Summarization
- Authors
- 이영훈; 정유철
- Issue Date
- Mar-2022
- Publisher
- 한국정보기술학회
- Keywords
- summarization; ROUGE; game review; BERT
- Citation
- 한국정보기술학회논문지, v.20, no.3, pp.35 - 46
- Journal Title
- 한국정보기술학회논문지
- Volume
- 20
- Number
- 3
- Start Page
- 35
- End Page
- 46
- URI
- https://scholarworks.bwise.kr/kumoh/handle/2020.sw.kumoh/21058
- DOI
- 10.14801/jkiit.2022.20.3.35
- ISSN
- 1598-8619
- Abstract
- Recall-oriented understudy for gisting evaluation (ROUGE) is a prevalent evaluation measure in the field of natural language processing, especially for text summarization. However, ROUGE's reliability has been continuously debated because a high ROUGE score does not guarantee a high-quality summary and vice versa. As an empirical study in the video game review summary, we address that existing state-of-the-art summarization techniques fail in generating high-quality game review summaries, and ROUGE scores for those summaries are quite problematic. To this end, game review data are newly collected, and BERT based automatic review summarizations are performed on the dataset to reconsider ROUGE use in video game review summarizations. Especially, we provide an in-depth discussion between the ROUGE score and the scores of human annotators in terms of game review factors.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - ETC > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.