Video completion using block matching for video stabilization

Abstract

This paper presents a video completion algorithm using block matching for video stabilization. In order to fill in missing pixels, the proposed algorithm consists of three steps: i) mosaicking for covering the missing static, planar regions, ii) estimation of local motion vectors using the hierarchical Lucas-Kanade optical flow method, and iii) selection of the most similar patch in both spatial and temporal neighbors. The proposed video completion algorithm can be applied in the wide areas of consumer electronics including camcorders, smart phone cameras, tablet cameras, and smart glasses.