Share Email Print

Proceedings Paper

Modeling sports highlights using a time-series clustering framework and model interpretation
Author(s): Regunathan Radhakrishnan; Isao Otsuka; Ziyou Xiong; Ajay Divakaran
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In our past work on sports highlights extraction, we have shown the utility of detecting audience reaction using an audio classification framework. The audio classes in the framework were chosen based on intuition. In this paper, we present a systematic way of identifying the key audio classes for sports highlights extraction using a time series clustering framework. We treat the low-level audio features as a time series and model the highlight segments as "unusual" events in a background of an "usual" process. The set of audio classes to characterize the sports domain is then identified by analyzing the consistent patterns in each of the clusters output from the time series clustering framework. The distribution of features from the training data so obtained for each of the key audio classes, is parameterized by a Minimum Description Length Gaussian Mixture Model (MDL-GMM). We also interpret the meaning of each of the mixture components of the MDL-GMM for the key audio class (the "highlight" class) that is correlated with highlight moments. Our results show that the "highlight" class is a mixture of audience cheering and commentator's excited speech. Furthermore, we show that the precision-recall performance for highlights extraction based on this "highlight" class is better than that of our previous approach which uses only audience cheering as the key highlight class.

Paper Details

Date Published: 17 January 2005
PDF: 8 pages
Proc. SPIE 5682, Storage and Retrieval Methods and Applications for Multimedia 2005, (17 January 2005); doi: 10.1117/12.588059
Show Author Affiliations
Regunathan Radhakrishnan, Mitsubishi Electric Research Lab. (United States)
Isao Otsuka, Mitsubishi Electric Corp. (Japan)
Ziyou Xiong, Mitsubishi Electric Research Lab. (United States)
Ajay Divakaran, Mitsubishi Electric Research Lab. (United States)

Published in SPIE Proceedings Vol. 5682:
Storage and Retrieval Methods and Applications for Multimedia 2005
Rainer W. Lienhart; Noboru Babaguchi; Edward Y. Chang, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?