Share Email Print
cover

Proceedings Paper

A neural network approach to key frame extraction
Author(s): Rajesh Narasimha; Andreas Savakis; Raghuveer M Rao; Ricardo De Queiroz
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

We present a neural network based approach to key frame extraction in the compressed domain. The proposed method is an amalgamation of both the MPEG-7 descriptors namely motion intensity descriptor and spatial activity descriptor. Shot boundary detection and block motion estimation techniques are employed prior to the extraction of the descriptors. The motion intensity (“pace of action”) is obtained using a fuzzy system that classifies the motion intensity into five categories proportional to the intensity. The spatial activity matrix determines the spatial distribution of activity (“active regions”) in a frame. A neural network is used to pick those frames as key frames which have high intensity and maximum spatial activity at the center of the frame. Results are compared against two well-known key frame extraction techniques to demonstrate the advantage and robustness of the proposed approach. Results show that the neural network approach performs much better than selecting first frame of the shot as a key frame and selecting middle frame of the shot as a key frame methods.

Paper Details

Date Published: 18 December 2003
PDF: 9 pages
Proc. SPIE 5307, Storage and Retrieval Methods and Applications for Multimedia 2004, (18 December 2003); doi: 10.1117/12.517478
Show Author Affiliations
Rajesh Narasimha, Georgia Institute of Technology (United States)
Andreas Savakis, Rochester Institute of Technology (United States)
Raghuveer M Rao, Rochester Institute of Technology (United States)
Ricardo De Queiroz, Xerox Corp. (United States)


Published in SPIE Proceedings Vol. 5307:
Storage and Retrieval Methods and Applications for Multimedia 2004
Minerva M. Yeung; Rainer W. Lienhart; Chung-Sheng Li, Editor(s)

© SPIE. Terms of Use
Back to Top