End-to-End Learning for Omnidirectional Stereo Matching With Uncertainty Prior
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Won, Changhee | - |
dc.contributor.author | Ryu, Jongbin | - |
dc.contributor.author | Lim, Jongwoo | - |
dc.date.accessioned | 2022-07-06T11:42:07Z | - |
dc.date.available | 2022-07-06T11:42:07Z | - |
dc.date.created | 2021-12-08 | - |
dc.date.issued | 2021-11 | - |
dc.identifier.issn | 0162-8828 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/140530 | - |
dc.description.abstract | In this paper, we propose a novel end-to-end deep neural network model for omnidirectional depth estimation from a wide-baseline multi-view stereo setup. The images captured with ultra-wide field-of-view cameras on an omnidirectional rig are processed by the feature extraction module, and then the deep feature maps are warped onto the concentric spheres swept through all candidate depths using the calibrated camera parameters. The 3D encoder-decoder block takes the aligned feature volume to produce an omnidirectional depth estimate with regularization on uncertain regions utilizing the global context information. For more accurate depth estimation we also propose an uncertainty prior guidance in two ways: depth map filtering and guiding regularization. In addition, we present large-scale synthetic datasets for training and testing omnidirectional multi-view stereo algorithms. Our datasets consist of 13K ground-truth depth maps and 53K fisheye images in four orthogonal directions with various objects and environments. Experimental results show that the proposed method generates excellent results in both synthetic and real-world environments, and it outperforms the prior art and the omnidirectional versions of the state-of-the-art conventional stereo algorithms. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | IEEE COMPUTER SOC | - |
dc.title | End-to-End Learning for Omnidirectional Stereo Matching With Uncertainty Prior | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Lim, Jongwoo | - |
dc.identifier.doi | 10.1109/TPAMI.2020.2992497 | - |
dc.identifier.scopusid | 2-s2.0-85116549043 | - |
dc.identifier.wosid | 000702649700012 | - |
dc.identifier.bibliographicCitation | IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, v.43, no.11, pp.3850 - 3862 | - |
dc.relation.isPartOf | IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE | - |
dc.citation.title | IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE | - |
dc.citation.volume | 43 | - |
dc.citation.number | 11 | - |
dc.citation.startPage | 3850 | - |
dc.citation.endPage | 3862 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Artificial Intelligence | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.subject.keywordAuthor | Cameras | - |
dc.subject.keywordAuthor | Estimation | - |
dc.subject.keywordAuthor | Three-dimensional displays | - |
dc.subject.keywordAuthor | Neural networks | - |
dc.subject.keywordAuthor | Uncertainty | - |
dc.subject.keywordAuthor | Lenses | - |
dc.subject.keywordAuthor | Computational modeling | - |
dc.subject.keywordAuthor | Deep neural network | - |
dc.subject.keywordAuthor | stereo matching | - |
dc.subject.keywordAuthor | omnidirectional 3D estimation | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.