Share Email Print
cover

Proceedings Paper

Tracking a user's face and hands in three-dimensions in real-time
Author(s): Corey Manders; Farzam Farbiz; Ishtiaq Rasool Khan; Miaolong Yuan; Ka Yin Tang; Mei Hwan Loke; Gim Guan Chua
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

This work outlines a system in which a stereo camera may effectively track a user's face and hands in three dimensions. Given this information, a method for controlling objects in three dimensions is also described. The system begins by finding faces. If more than one face is found in the image, the algorithm uses depth information to isolate the face that is closest to the camera. The algorithm then gathers information about the user's skin tone by examining the content of the face found. For much of the processing, only the hue and saturation components are used after applying an HSV to RGB transformation given the camera output. The skin tone information in tandem with depth is then used to isolate the user's hands, and track them in three dimensions. To be used as an effective interface, the system uses information of the two hands relative to the user's face. In controlling an object in three dimensions, if the user would like to move the object up, he or she simply positions both hands above his or her face. Similar commands allow the user to apply a translational factor in three dimensions, as well as applying yaw and roll when wanted.

Paper Details

Date Published: 3 February 2009
PDF: 10 pages
Proc. SPIE 7251, Image Processing: Machine Vision Applications II, 72510L (3 February 2009); doi: 10.1117/12.806097
Show Author Affiliations
Corey Manders, A*STAR Institute for Infocomm Research (Singapore)
Farzam Farbiz, A*STAR Institute for Infocomm Research (Singapore)
Ishtiaq Rasool Khan, A*STAR Institute for Infocomm Research (Singapore)
Miaolong Yuan, A*STAR Institute for Infocomm Research (Singapore)
Ka Yin Tang, A*STAR Institute for Infocomm Research (Singapore)
Mei Hwan Loke, A*STAR Institute for Infocomm Research (Singapore)
Gim Guan Chua, A*STAR Institute for Infocomm Research (Singapore)


Published in SPIE Proceedings Vol. 7251:
Image Processing: Machine Vision Applications II
Kurt S. Niel; David Fofi, Editor(s)

© SPIE. Terms of Use
Back to Top