Online Keyframe Selection Scheme for Semantic Video Segmentation
- Authors
- Awan, M.[Awan, M.]; Shin, J.[Shin, J.]
- Issue Date
- 2020
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- deep reinforcement learning; keyframe selection scheme; semantic video segmentation
- Citation
- 2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020
- Indexed
- SCOPUS
- Journal Title
- 2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020
- URI
- https://scholarworks.bwise.kr/skku/handle/2021.sw.skku/6361
- DOI
- 10.1109/ICCE-Asia49877.2020.9276838
- ISSN
- 0000-0000
- Abstract
- In this paper, we propose an online keyframe selection scheme for video analysis tasks based on deep reinforcement learning. Optimal keyframe selection is a crucial job for preserving the temporal updates in the video sequence since it affects the accuracy and throughput of the whole video analysis framework to a great degree. Our scheme is generic and can be used for the simultaneous decision of keyframe in any real-time video based task. We employ policy gradient reinforcement strategy to learn policy function for maximizing the expected reward. The proposed selection network has two actions (key and non-key) in the action space. State information is derived from the element-wise difference image of keyframe and the current frame. We adopt deep feature flow approach for feature propagation between keyframe and the current frame. We evaluate our scheme on the Cityscapes dataset with DeepLabv3 as segmentation network and LiteFlowNet for computing flow fields. © 2020 IEEE.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Information and Communication Engineering > School of Electronic and Electrical Engineering > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/skku/handle/2021.sw.skku/6361)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.