A spatial-temporal hole filling approach with background modeling and texture synthesis for 3D Video

Abstract

This paper presents a hole-filling method based on spatialtemporal background information for view synthesis in 3D Video. The process of obtaining stationary background information is updated with a new background codebook in order to extract reliable temporal background modeling. An estimation of local background value is conducted to discriminate an adaptively boundary between the background region and the foreground region as well as to update the information about the hole region. The holes are filled by combining the spatial background information and the temporal background information. In addition, an exemplar-based inpainting method is used to fill the rest of holes, in which a priority function using background depth information is defined to determine the order in which the holes are filled. The experimental results demonstrated that the proposed algorithm synthesized satisfactory views regardless of video characteristics and type of hole region. © 2015 ACM.