OmniMVS: End-to-end learning for omnidirectional stereo matching
- Authors
- Won, Changhee; Ryu, Jongbin; Lim, Jongwoo
- Issue Date
- Nov-2019
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Citation
- Proceedings of the IEEE International Conference on Computer Vision, v.2019-October, pp.8986 - 8995
- Indexed
- SCOPUS
- Journal Title
- Proceedings of the IEEE International Conference on Computer Vision
- Volume
- 2019-October
- Start Page
- 8986
- End Page
- 8995
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/146814
- DOI
- 10.1109/ICCV.2019.00908
- ISSN
- 1550-5499
- Abstract
- In this paper, we propose a novel end-to-end deep neural network model for omnidirectional depth estimation from a wide-baseline multi-view stereo setup. The images captured with ultra wide field-of-view (FOV) cameras on an omnidirectional rig are processed by the feature extraction module, and then the deep feature maps are warped onto the concentric spheres swept through all candidate depths using the calibrated camera parameters. The 3D encoder-decoder block takes the aligned feature volume to produce the omnidirectional depth estimate with regularization on uncertain regions utilizing the global context information. In addition, we present large-scale synthetic datasets for training and testing omnidirectional multi-view stereo algorithms. Our datasets consist of 11K ground-truth depth maps and 45K fisheye images in four orthogonal directions with various objects and environments. Experimental results show that the proposed method generates excellent results in both synthetic and real-world environments, and it outperforms the prior art and the omnidirectional versions of the state-of-the-art conventional stereo algorithms.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 컴퓨터소프트웨어학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/146814)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.