Share Email Print

Journal of Electronic Imaging

Video genre categorization and representation using audio-visual information
Author(s): Bogdan E. Ionescu; Christoph Rasche; Constantin Vertan; Patrick Lambert; Klaus Seyerlehner
Format Member Price Non-Member Price
PDF $20.00 $25.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

We propose an audio-visual approach to video genre classification using content descriptors that exploit audio, color, temporal, and contour information. Audio information is extracted at block-level, which has the advantage of capturing local temporal information. At the temporal structure level, we consider action content in relation to human perception. Color perception is quantified using statistics of color distribution, elementary hues, color properties, and relationships between colors. Further, we compute statistics of contour geometry and relationships. The main contribution of our work lies in harnessing the descriptive power of the combination of these descriptors in genre classification. Validation was carried out on over 91 h of video footage encompassing 7 common video genres, yielding average precision and recall ratios of 87% to 100% and 77% to 100%, respectively, and an overall average correct classification of up to 97%. Also, experimental comparison as part of the MediaEval 2011 benchmarking campaign demonstrated the efficiency of the proposed audio-visual descriptors over other existing approaches. Finally, we discuss a 3-D video browsing platform that displays movies using feature-based coordinates and thus regroups them according to genre.

Paper Details

Date Published: 22 June 2012
PDF: 18 pages
J. Electron. Imaging. 21(2) 023017 doi: 10.1117/1.JEI.21.2.023017
Published in: Journal of Electronic Imaging Volume 21, Issue 2
Show Author Affiliations
Bogdan E. Ionescu, Polytechnical Univ. of Bucharest (Romania)
Christoph Rasche, Polytechnical Univ. of Bucharest (Romania)
Constantin Vertan, Polytechnical Univ. of Bucharest (Romania)
Patrick Lambert, Univ. de Savoie (France)
Klaus Seyerlehner, Johannes Kepler Univ. Linz (Austria)

© SPIE. Terms of Use
Back to Top