Object Segmentation Ensuring Consistency Across Multi-Viewpoint Images
- Authors
- Jeong, Seunghwa; Lee, Jungjin; Kim, Bumki; Kim, Younghui; Noh, Junyong
- Issue Date
- Oct-2018
- Publisher
- IEEE COMPUTER SOC
- Keywords
- Multi-view segmentation; wide-baseline capture environment; inter-view consistency; depth projection
- Citation
- IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, v.40, no.10, pp.2455 - 2468
- Journal Title
- IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
- Volume
- 40
- Number
- 10
- Start Page
- 2455
- End Page
- 2468
- URI
- http://scholarworks.bwise.kr/ssu/handle/2018.sw.ssu/40656
- DOI
- 10.1109/TPAMI.2017.2757928
- ISSN
- 0162-8828
- Abstract
- We present a hybrid approach that segments an object by using both color and depth information obtained from views captured from a low-cost RGBD camera and sparsely-located color cameras. Our system begins with generating dense depth information of each target image by using Structure from Motion and Joint Bilateral Upsampling. We formulate the multi-view object segmentation as the Markov Random Field energy optimization on the graph constructed from the superpixels. To ensure inter-view consistency of the segmentation results between color images that have too few color features, our local mapping method generates dense inter-view geometric correspondences by using the dense depth images. Finally, the pixel-based optimization step refines the boundaries of the results obtained from the superpixel-based binary segmentation. We evaluate the validity of our method under various capture conditions such as numbers of views, rotations, and distances between cameras. We compared our method with the state-of-the-art methods that use the standard multi-view datasets. The comparison verified that the proposed method works very efficiently especially in a sparse wide-baseline capture environment.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Information Technology > Global School of Media > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.