Share Email Print

Journal of Electronic Imaging

Video summarization using descriptors of motion activity: a motion activity based approach to key-frame extraction from video shots
Format Member Price Non-Member Price
PDF $20.00 $25.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

We describe a video summarization technique that uses motion descriptors computed in the compressed domain. It can either speed up conventional color-based video summarization techniques, or rapidly generate a key-frame based summary by itself. The basic hypothesis of the work is that the intensity of motion activity of a video segment is a direct indication of its ‘‘summarizability,’’ which we experimentally verify using the MPEG-7 [MPEG-7 Visual Committee Draft URL: documents. htm official MPEG site] motion activity descriptor and the fidelity measure proposed in H. S. Chang, S. Sull, and S. U. Lee, ‘‘Efficient video indexing scheme for content-based retrieval,’’ IEEE Trans. Circuits Syst. Video Technol. 9(8), (1999). Note that the compressed domain extraction of motion activity intensity is much simpler than the color-based calculations. We are thus able to quickly identify easy to summarize segments of a video sequence since they have a low intensity of motion activity. We are able to easily summarize these segments by simply choosing their first frames. We can then apply conventional color-based summarization techniques to the remaining segments. We thus speed up color-based summarization by reducing the number of segments processed. Our results also motivate a simple and novel key-frame extraction technique that relies on a motion activity based nonuniform sampling of the frames. Our results indicate that it can either be used by itself or to speed up color-based techniques as explained earlier.

Paper Details

Date Published: 1 October 2001
PDF: 8 pages
J. Electron. Imag. 10(4) doi: 10.1117/1.1406507
Published in: Journal of Electronic Imaging Volume 10, Issue 4
Show Author Affiliations
Ajay Divakaran, Mitsubishi Electric Research Labs. (United States)
Regunathan Radhakrishnan, Mitsubishi Electric Research Labs. (United States)
Kadir A. Peker, Mitsubishi Electric Research Labs. (United States)

© SPIE. Terms of Use
Back to Top