The Removal of Facial Structure Information for Face Replacement

Abstract

Recently, the image synthesis technology such as face replacement is gradually receiving attention. However, because of the difference of face structure information (FSI) between the target and reference face, the unnatural region is occurred in synthesized face. Here, the target image is background and the reference image is foreground which covers the target face. In this paper, we propose a method to solve this problem by removing FSI of target face such as eyes, eyebrows, nose and mouth with keeping illumination property. In experiment, we verified that the effectiveness of face replacement could be improved by using the proposed method.