Share Email Print
cover

Proceedings Paper

Exploring inter-frame correlation analysis and wavelet-domain modeling for real-time caption detection in streaming video
Author(s): Jia Li; Yonghong Tian; Wen Gao
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

In recent years, the amount of streaming video has grown rapidly on the Web. Often, retrieving these streaming videos offers the challenge of indexing and analyzing the media in real time because the streams must be treated as effectively infinite in length, thus precluding offline processing. Generally speaking, captions are important semantic clues for video indexing and retrieval. However, existing caption detection methods often have difficulties to make real-time detection for streaming video, and few of them concern on the differentiation of captions from scene texts and scrolling texts. In general, these texts have different roles in streaming video retrieval. To overcome these difficulties, this paper proposes a novel approach which explores the inter-frame correlation analysis and wavelet-domain modeling for real-time caption detection in streaming video. In our approach, the inter-frame correlation information is used to distinguish caption texts from scene texts and scrolling texts. Moreover, wavelet-domain Generalized Gaussian Models (GGMs) are utilized to automatically remove non-text regions from each frame and only keep caption regions for further processing. Experiment results show that our approach is able to offer real-time caption detection with high recall and low false alarm rate, and also can effectively discern caption texts from the other texts even in low resolutions.

Paper Details

Date Published: 28 January 2008
PDF: 12 pages
Proc. SPIE 6822, Visual Communications and Image Processing 2008, 68220F (28 January 2008); doi: 10.1117/12.759571
Show Author Affiliations
Jia Li, Institute of Computing Technology (China)
Graduate Univ. of Chinese Academy of Sciences (China)
Yonghong Tian, Peking Univ. (China)
Wen Gao, Institute of Computing Technology (China)
Peking Univ. (China)


Published in SPIE Proceedings Vol. 6822:
Visual Communications and Image Processing 2008
William A. Pearlman; John W. Woods; Ligang Lu, Editor(s)

© SPIE. Terms of Use
Back to Top