Share Email Print

Proceedings Paper

Video abstraction based on asymmetric similarity values
Author(s): Sorin Marcel Iacob; Reginald L. Lagendijk; M. E. Iacob
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The paper addresses visual similarity measuring and hierarchical groping of the most representative frames for the purpose of video abstraction. Our approach concentrates on measuring similarity of image regions. To produce a visual similarity measure we used as primary information the color histograms in the YUV color space. The difference from previous histogram based approaches is that we divide the input images into rectangles whose sizes depend on the local 'structure' of the image. We assume that similar regions in two different images would have approximately the same rectangle structure. Therefore, it should ge enough to compare the color histogram of the pixels within these rectangles in order to determine the similarity of two regions in two different images. We measure similarity between regions by a similarity score that is asymmetric. Such a measure cannot be used in classical clustering techniques for grouping representative frames. Our approach is therefore based on graph theoretic techniques. First, we construct an oriented weighted graph having as vertices the original set of key-frames. Next, we construct the set of weighted edges, according to the similarity values computed for each ordered pair of key-frames. Finally, we transform this graph into a collection of two-level trees, whose root key-frames form an abstract of the original ones. For graph construction and transformation, we present here two algorithms. The experiments we performed with the proposed technique showed improvements with respect to the way the visual content is represented. This conclusion is based on subjective assessment of the result groupings and the selection of the most representative key-frame.

Paper Details

Date Published: 24 August 1999
PDF: 11 pages
Proc. SPIE 3846, Multimedia Storage and Archiving Systems IV, (24 August 1999); doi: 10.1117/12.360422
Show Author Affiliations
Sorin Marcel Iacob, Delft Univ. of Technology (Netherlands)
Reginald L. Lagendijk, Delft Univ. of Technology (Netherlands)
M. E. Iacob, Univ. of Cluj-Napoca (Romania)

Published in SPIE Proceedings Vol. 3846:
Multimedia Storage and Archiving Systems IV
Sethuraman Panchanathan; Shih-Fu Chang; C.-C. Jay Kuo, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?