This paper presents a shot boundary detection (SBD) method that finds boundaries between shots using the changes in visual content elements such as objects, actors, and background. Our work presented in this paper is based on the property that the features do not change significantly within a shot whereas they change substantially across a shot boundary. Noticing this characteristic of shot boundaries, we propose a SBD algorithm using the scale- and rotationinvariant local image descriptors. To obtain information of the content elements, we employ the scale invariant feature transform (SIFT) that has been commonly used in object recognition. The number of matched points is large within the same shot whereas zero or the small number of matched points is detected at the shot boundary because all the elements in the previous shot change abruptly in the next shot. Thus we can determine the existence of shot boundaries by the number of matched points. We identify two types of shot boundaries (hard-cut and gradual-transition such as tiling, panning, and fade in/out) with a adjustable frame distance between consecutive frames. Experimental results with four test videos show the effectiveness of the proposed SBD algorithm using scale invariant feature matching.

Date Published: 19 January 2006
PDF: 9 pages
Proc. SPIE 6077, Visual Communications and Image Processing 2006, 60771N (19 January 2006); doi: 10.1117/12.642244

Published in SPIE Proceedings Vol. 6077:
Visual Communications and Image Processing 2006
John G. Apostolopoulos; Amir Said, Editor(s)