Real-time rendering of multi-view images from a single image with depth

Abstract

Image reprojection is a technique to generate novel images by projecting a reference image of an arbitrary view. Previous image reprojection methods often run on the CPU, but these approaches take high-cost for rendering. We present a real-time image reprojection method using the GPU entirely. From given a reference image and its depth image of the scene prerendered, we generate novel images at arbitrary view points without the original geometry data. We render a simple plane at a novel view, and for each pixel being rendered, we make a ray that faces the opposite direction of the view. Then, we transform the ray to reference image space and trace the ray through a depth image to find an intersection, using a recently proposed method. In our experience, we archived tens of frames per second and it was independent from the complexity of the scene. © 2007 IEEE.