Hole filling algorithm using spatial-temporal background depth map for view synthesis in free view point television

Abstract

This paper presents a new hole filling algorithm based on background modeling and texture synthesis. Depth information of hole areas is computed by using a local background estimation method. In order to exploit the correlation between frames in temporal domain, a background modeling method is used to extract reliable background reference scenes. The holes are then filled by combining the temporal background information and the estimated depth information. A modified exemplar-based inpainting method is used to fill remaining hole pixels. Experimental results demonstrate the capability of the proposed algorithm. © Springer International Publishing Switzerland 2015.