Share Email Print

Proceedings Paper

Quantifying the effect of disruptions to temporal coherence on the intelligibility of compressed American Sign Language video
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Communication of American Sign Language (ASL) over mobile phones would be very beneficial to the Deaf community. ASL video encoded to achieve the rates provided by current cellular networks must be heavily compressed and appropriate assessment techniques are required to analyze the intelligibility of the compressed video. As an extension to a purely spatial measure of intelligibility, this paper quantifies the effect of temporal compression artifacts on sign language intelligibility. These artifacts can be the result of motion-compensation errors that distract the observer or frame rate reductions. They reduce the the perception of smooth motion and disrupt the temporal coherence of the video. Motion-compensation errors that affect temporal coherence are identified by measuring the block-level correlation between co-located macroblocks in adjacent frames. The impact of frame rate reductions was quantified through experimental testing. A subjective study was performed in which fluent ASL participants rated the intelligibility of sequences encoded at a range of 5 different frame rates and with 3 different levels of distortion. The subjective data is used to parameterize an objective intelligibility measure which is highly correlated with subjective ratings at multiple frame rates.

Paper Details

Date Published: 10 February 2009
PDF: 10 pages
Proc. SPIE 7240, Human Vision and Electronic Imaging XIV, 72400D (10 February 2009); doi: 10.1117/12.808229
Show Author Affiliations
Frank M. Ciaramello, Cornell Univ. (United States)
Sheila S. Hemami, Cornell Univ. (United States)

Published in SPIE Proceedings Vol. 7240:
Human Vision and Electronic Imaging XIV
Bernice E. Rogowitz; Thrasyvoulos N. Pappas, Editor(s)

© SPIE. Terms of Use
Back to Top