PoSNet: 4x video frame interpolation using position-specific flow
- Authors
- Yu, Songhyun; Park, Bumjun; Jeong, Jechang
- Issue Date
- Oct-2019
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- Optical flow estimation; Video enhancement; Video frame interpolation
- Citation
- Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019, pp.3503 - 3511
- Indexed
- SCOPUS
- Journal Title
- Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019
- Start Page
- 3503
- End Page
- 3511
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/4521
- DOI
- 10.1109/ICCVW.2019.00434
- ISSN
- 2473-9936
- Abstract
- Video frame interpolation has been studied for a long time; however, it is still a difficult low-level vision task. Owing to the improved performance of optical flow estimation, frame-interpolation studies based on optical flow are actively conducted. However, the existing methods are generally tested using high-fps sequences and developed for 2× upscaling or generating multiple frames with a single estimator. This paper proposes a 4× video-interpolation framework that aims to convert 15-fps to 60-fps videos based on a structure comprising flow estimation followed by an enhancement network. We improve the performance by training specialized flow estimators for each direction and frame position. Furthermore, we use the original frames and flow maps as additional inputs for the enhancement network to improve the subjective image quality. Consequently, the proposed network interpolates high-quality frames with a fast runtime and demonstrates its superiority in the AIM 2019 video temporal super-resolution challenge. The associated code is available at https://github.com/SonghyunYu/PoSNet.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 융합전자공학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/4521)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.