Multi-scale contrast and relative motion-based key frame extractionopen access
- Authors
- Ejaz, Naveed; Baik, Sung Wook; Majeed, Hammad; Chang, Hangbae; Mehmood, Irfan
- Issue Date
- Jun-2018
- Publisher
- SPRINGER INTERNATIONAL PUBLISHING AG
- Keywords
- Key frame extraction; Video summarization; Visual saliency; Visual attention model; Fusion mechanism; Video summary evaluation
- Citation
- EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, v.2018, no.1
- Journal Title
- EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING
- Volume
- 2018
- Number
- 1
- URI
- https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/2066
- DOI
- 10.1186/s13640-018-0280-z
- ISSN
- 1687-5281
1687-5281
- Abstract
- The huge amount of video data available these days requires effective management techniques for storage, indexing, and retrieval. Video summarization, a method to manage video data, provides concise versions of the videos for efficient browsing and retrieval. Key frame extraction is a form of video summarization which selects only the most salient frames from a given video. Since the automatic semantic understanding of the video contents is not possible so far, most of the existing works employ low level index features for extracting key frames. However, the usage of low level features results in loss of semantic details, thus leading to a semantic gap. In this context, the saliency-based user attention modeling technique can be used to bridge this semantic gap. In this paper, a key frame extraction scheme based on a visual attention mechanism is proposed. The proposed scheme builds static visual attention method based on multi-scale contrast instead of usual color contrast. The dynamic visual attention model is developed based on novel relative motion intensity and relative motion orientation. An efficient fusion scheme for combining three visual attention values is then proposed. A flexible technique is then used for key frame extraction. The experimental results demonstrate that the proposed mechanism provides excellent results as compared to the some of the other prominent techniques in the literature.
- Files in This Item
-
- Appears in
Collections - College of Business & Economics > Department of Industrial Security > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.