Share Email Print

Proceedings Paper

Virtual view image synthesis for eye-contact in TV conversation system
Author(s): Daisuke Murayama; Keiichi Kimura; Tadaaki Hosaka; Takayuki Hamamoto; Nao Shibuhisa; Seiichi Tanaka; Shunichi Sato; Sakae Saito
Format Member Price Non-Member Price
PDF $17.00 $21.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Eye-contact plays an important role for human communications in the sense that it can convey unspoken information. However, it is highly difficult to realize eye-contact in teleconferencing systems because of camera configurations. Conventional methods to overcome this difficulty mainly resorted to space-consuming optical devices such as half mirrors. In this paper, we propose an alternative approach to achieve eye-contact by techniques of arbitrary view image synthesis. In our method, multiple images captured by real cameras are converted to the virtual viewpoint (the center of the display) by homography, and evaluation of matching errors among these projected images provides the depth map and the virtual image. Furthermore, we also propose a simpler version of this method by using a single camera to save the computational costs, in which the only one real image is transformed to the virtual viewpoint based on the hypothesis that the subject is located at a predetermined distance. In this simple implementation, eye regions are separately generated by comparison with pre-captured frontal face images. Experimental results of both the methods show that the synthesized virtual images enable the eye-contact favorably.

Paper Details

Date Published: 4 February 2010
PDF: 10 pages
Proc. SPIE 7526, Three-Dimensional Image Processing (3DIP) and Applications, 75260B (4 February 2010); doi: 10.1117/12.839121
Show Author Affiliations
Daisuke Murayama, Tokyo Univ. of Science (Japan)
Keiichi Kimura, Tokyo Univ. of Science (Japan)
Tadaaki Hosaka, Tokyo Univ. of Science (Japan)
Takayuki Hamamoto, Tokyo Univ. of Science (Japan)
Nao Shibuhisa, Sharp Corp. (Japan)
Seiichi Tanaka, Sharp Corp. (Japan)
Shunichi Sato, Sharp Corp. (Japan)
Sakae Saito, Sharp Corp. (Japan)

Published in SPIE Proceedings Vol. 7526:
Three-Dimensional Image Processing (3DIP) and Applications
Atilla M. Baskurt, Editor(s)

© SPIE. Terms of Use
Back to Top