There is only you: Actively diminishing people in a scene

Abstract

There are various objects in a scene, and some of them are unwanted. In particular, background photographs and portraits contain photographs of unwanted people. It is also problematic to include unwanted objects in terms of portrait rights, trademark exposure, and copyright protection. It is important to diminish these unwanted objects more naturally than to simply erase or mosaic them. We propose a method to actively detect a person and naturally fill that region. The proposed methods perform diminishing people by combining an object detection method based on deep learning and an exemplar-based image inpainting method. To measure the performance accurately, the object to be removed is synthesized with the image. In addition, we constructed the proposed method partially or in whole by deep learning and compared the results.