Share Email Print

Proceedings Paper

Optimized sign language video coding based on eye-tracking analysis
Author(s): Dimitris Agrafiotis; C. Nishan Canagarajah; David R. Bull; Matt Dye; Helen Twyford; Jim Kyle; James Chung How
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

The imminent arrival of mobile video telephony will enable deaf people to communicate - as hearing people have been able to do for a some time now - anytime/anywhere in their own language sign language. At low bit rates coding of sign language sequences is very challenging due to the high level of motion and the need to maintain good image quality to aid with understanding. This paper presents optimised coding of sign language video at low bit rates in a way that will favour comprehension of the compressed material by deaf users. Our coding suggestions are based on an eye-tracking study that we have conducted which allows us to analyse the visual attention of sign language viewers. The results of this study are included in this paper. Analysis and results for two coding methods, one using MPEG-4 video objects and the second using foveation filtering are presented. Results with foveation filtering are very promising, offering a considerable decrease in bit rate in a way which is compatible with the visual attention patterns of deaf people, as these were recorded in the eye tracking study.

Paper Details

Date Published: 23 June 2003
PDF: 9 pages
Proc. SPIE 5150, Visual Communications and Image Processing 2003, (23 June 2003); doi: 10.1117/12.503107
Show Author Affiliations
Dimitris Agrafiotis, Univ. of Bristol (United Kingdom)
C. Nishan Canagarajah, Univ. of Bristol (United Kingdom)
David R. Bull, Univ. of Bristol (United Kingdom)
Matt Dye, Rochester Institute of Technology (United States)
Helen Twyford, Univ. of Bristol (United Kingdom)
Jim Kyle, Univ. of Bristol (United Kingdom)
James Chung How, ProVision Communication Technologies Ltd. (United Kingdom)

Published in SPIE Proceedings Vol. 5150:
Visual Communications and Image Processing 2003
Touradj Ebrahimi; Thomas Sikora, Editor(s)

© SPIE. Terms of Use
Back to Top