A image processing pipeline is presented that applies principles from the computer graphics technique of deferred shading to composite rendered objects into a live scene viewed by a Kinect. Issues involving the presentation of the Kinect's output are addressed, and algorithms for improving the believability and aesthetic matching of the rendered scene against the real scene are proposed. An implementation of this pipeline using GLSL shaders to perform this pipeline at interactive framerates is given. The results of experiments with this program are provided that show promise that the approaches evaluated here can be applied to improve other implementations.

Date Published: 12 March 2013
PDF: 9 pages
Proc. SPIE 8650, Three-Dimensional Image Processing (3DIP) and Applications 2013, 86500Y (12 March 2013); doi: 10.1117/12.2004183

Published in SPIE Proceedings Vol. 8650:
Three-Dimensional Image Processing (3DIP) and Applications 2013
Atilla M. Baskurt; Robert Sitnik, Editor(s)