Integrating character networks for extracting narratives from multimodal data
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Lee, O.-J. | - |
dc.contributor.author | Jung, Jason J. | - |
dc.date.available | 2019-05-28T03:33:00Z | - |
dc.date.issued | 2019-09 | - |
dc.identifier.issn | 0306-4573 | - |
dc.identifier.issn | 1873-5371 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/18488 | - |
dc.description.abstract | This study aims to integrate diverse data within narrative multimedia (i.e., artworks containing stories and distributed through multimedia) into a unified character network (i.e., a social network between characters that appear in the story). By combining multiple data sources (e.g., the text, video, and audio), we attempted to enhance the accuracy and semantic richness of existing character networks that confine themselves to a particular data source. To merge various data, we propose story synchronization for (i) improving the accuracy of data extracted from the narrative multimedia and (ii) integrating the data into the unified character network. The story synchronization mainly consists of three steps: synchronizing (i) scenes, (ii) characters, and (iii) character networks. First, we synchronize dialogues in the text and audio, to discover speakers and time of dialogues. This enables us to segment the scene using time periods when dialogues (in the text and audio) and characters (in the video) do not commonly occur. Through the scene segmentation, we can discretize stories in the narrative work. By comparing the occurrence of dialogues and characters in each scene, we synchronize identities of the characters in the text and video (e.g., names and faces of characters). Thereby, we can more accurately estimate participants and time of a conversation between characters (i.e., a set of connected dialogues). Based on the conversation, the existing character networks are refined and integrated into the unified character network. In addition, we verified the efficacy of the proposed methods using movies in the real world, which are among the most accessible and popular narrative multimedia. © 2019 Elsevier Ltd | - |
dc.format.extent | 30 | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Elsevier Ltd | - |
dc.title | Integrating character networks for extracting narratives from multimodal data | - |
dc.type | Article | - |
dc.identifier.doi | 10.1016/j.ipm.2019.02.005 | - |
dc.identifier.bibliographicCitation | Information Processing and Management, v.56, no.5, pp 1894 - 1923 | - |
dc.description.isOpenAccess | N | - |
dc.identifier.wosid | 000474504100018 | - |
dc.identifier.scopusid | 2-s2.0-85061632156 | - |
dc.citation.endPage | 1923 | - |
dc.citation.number | 5 | - |
dc.citation.startPage | 1894 | - |
dc.citation.title | Information Processing and Management | - |
dc.citation.volume | 56 | - |
dc.type.docType | Article | - |
dc.publisher.location | 영국 | - |
dc.subject.keywordAuthor | Character network | - |
dc.subject.keywordAuthor | Computational narrative | - |
dc.subject.keywordAuthor | Story analytics | - |
dc.subject.keywordAuthor | Story synchronization | - |
dc.subject.keywordPlus | Data mining | - |
dc.subject.keywordPlus | Semantics | - |
dc.subject.keywordPlus | Synchronization | - |
dc.subject.keywordPlus | Computational narrative | - |
dc.subject.keywordPlus | Data-source | - |
dc.subject.keywordPlus | Multi-modal data | - |
dc.subject.keywordPlus | Multiple data sources | - |
dc.subject.keywordPlus | Real-world | - |
dc.subject.keywordPlus | Scene segmentation | - |
dc.subject.keywordPlus | Story analytics | - |
dc.subject.keywordPlus | Time-periods | - |
dc.subject.keywordPlus | Data integration | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Information Science & Library Science | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Information Science & Library Science | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | ssci | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.