Robust temporal super-resolution for dynamic motion videos
- Authors
- Park, Bumjun; Yu, Songhyun; Jeong, Jechang
- Issue Date
- Oct-2019
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- Deep learning; Frame interpolation; Temporal super resolution
- Citation
- Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019, pp.3494 - 3502
- Indexed
- SCOPUS
- Journal Title
- Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019
- Start Page
- 3494
- End Page
- 3502
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/4520
- DOI
- 10.1109/ICCVW.2019.00433
- ISSN
- 2473-9936
- Abstract
- It is difficult to apply most video temporal super-resolution studies for real-world scenes because they are optimized for a specific range of characteristics. In this paper, we propose a video temporal super-resolution method that is tolerant to motion diversity and noise. Our proposed method improves its robustness by fine-tuning the pre-trained SPyNet that is trained for videos with simple motions and moderate conditions. Moreover, our proposed network learns to accurately synthesize two frames generated by a backward warping function without requiring any additional information using the architecture of a modified DHDN. This enables our proposed method to efficiently synthesize two warped frames by saving the computational complexity for pre-training and extracting the additional information. Finally, we apply the self-ensemble method, which is commonly used in studies on image processing but not on video processing. The application of the self-ensemble method enables our network to generate stable output frames with improved quality without any additional training. Our proposed network proved its performance by ranking 5th in the AIM 2019 video temporal super-resolution challenge; the performance gap between our proposed network and the 3rd- and 4th-ranked solutions was very small. The source code and pre-trained models are available at https://github.com/BumjunPark/DVTSR.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 융합전자공학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/4520)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.