Share Email Print

Proceedings Paper

Synchronization-sensitive motion and interpolation-based frame estimation in video lossy transmission
Author(s): Sherif G. Aly; Abdou Youssef
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In movie transmission, video frames are subject to loss due to noise and/or congestion. The loss of video frames could cause a loss of synchronization between the audio and video streams. If not corrected, this cumulative loss can seriously degrade the motion picture's quality beyond viewers' tolerance. Furthermore, many Internet applications providing video and audio streams have to operate in a limited resource environment. The luxury of time and abundant resources is not present, especially for applications like video conferencing and movie provision on demand. In this paper, we develop and study real time motion-based and interpolation-based techniques for performing synchronization-sensitive frame estimation using existing received frames only, without the need for retransmissions or error control information. The estimated frames are then injected at their appropriate locations in the movie stream in order to bring back the synchronization within the tolerance level of viewers. We attempt to find a very close estimation to the original frames at a suitable computation cost. We utilize a normalized luminance model for tracking motion between received frames in the presence of lost data. We ultimately use the generated motion vectors to reconstruct missing data in frames, and to restore synchronization loss between transmitted audio and video streams. We also develop quadratic and linear interpolations for the same purpose. In addition, hybrids of such techniques were developed to best utilize the performance of each developed frame estimation technique under varying degrees of losses and different scene types. Using our techniques, we were able to fully restore synchronization between audio and video streams, with a corresponding estimation of data loss. Both objective and subjective evaluations were performed on the achieved results.

Paper Details

Date Published: 22 March 2001
PDF: 11 pages
Proc. SPIE 4209, Multimedia Systems and Applications III, (22 March 2001); doi: 10.1117/12.420825
Show Author Affiliations
Sherif G. Aly, George Washington Univ. (United States)
Abdou Youssef, George Washington Univ. (United States)

Published in SPIE Proceedings Vol. 4209:
Multimedia Systems and Applications III
Andrew G. Tescher; Bhaskaran Vasudev; V. Michael Bove Jr., Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?