Share Email Print

Journal of Electronic Imaging

Temporal video segmentation using unsupervised clustering and semantic object tracking
Author(s): Bilge Gunsel; Ahmet Mufit Ferman; A. Murat Tekalp
Format Member Price Non-Member Price
PDF $20.00 $25.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

This paper proposes a content-based temporal video segmentation system that integrates syntactic (domain-independent) and semantic (domain-dependent) features for automatic management of video data. Temporal video segmentation includes scene change detection and shot classification. The proposed scene change detection method consists of two steps: detection and tracking of semantic objects of interest specified by the user, and an unsupervised method for detection of cuts, and edit effects. Object detection and tracking is achieved using a region matching scheme, where the region of interest is defined by the boundary of the object. A new unsupervised scene change detection method based on two-class clustering is introduced to eliminate the data dependency of threshold selection. The proposed shot classification approach relies on semantic image features and exploits domain-dependent visual properties such as shape, color, and spatial configuration of tracked semantic objects. The system has been applied to segmentation and classification of TV programs collected from different channels. Although the paper focuses on news programs, the method can easily be applied to other TV programs with distinct semantic structure.

Paper Details

Date Published: 1 July 1998
PDF: 13 pages
J. Electron. Imaging. 7(3) doi: 10.1117/1.482613
Published in: Journal of Electronic Imaging Volume 7, Issue 3
Show Author Affiliations
Bilge Gunsel, Univ. of Rochester (Turkey)
Ahmet Mufit Ferman, Univ. of Rochester (United States)
A. Murat Tekalp, Univ. of Rochester (United States)

© SPIE. Terms of Use
Back to Top