Share Email Print
cover

Proceedings Paper

Video mining using combinations of unsupervised and supervised learning techniques
Author(s): Ajay Divakaran; Koji Miyahara; Kadir Askin Peker; Regunathan Radhakrishnan; Ziyou Xiong
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

We discuss the meaning and significance of the video mining problem, and present our work on some aspects of video mining. A simple definition of video mining is unsupervised discovery of patterns in audio-visual content. Such purely unsupervised discovery is readily applicable to video surveillance as well as to consumer video browsing applications. We interpret video mining as content-adaptive or "blind" content processing, in which the first stage is content characterization and the second stage is event discovery based on the characterization obtained in stage 1. We discuss the target applications and find that using a purely unsupervised approach are too computationally complex to be implemented on our product platform. We then describe various combinations of unsupervised and supervised learning techniques that help discover patterns that are useful to the end-user of the application. We target consumer video browsing applications such as commercial message detection, sports highlights extraction etc. We employ both audio and video features. We find that supervised audio classification combined with unsupervised unusual event discovery enables accurate supervised detection of desired events. Our techniques are computationally simple and robust to common variations in production styles etc.

Paper Details

Date Published: 18 December 2003
PDF: 9 pages
Proc. SPIE 5307, Storage and Retrieval Methods and Applications for Multimedia 2004, (18 December 2003); doi: 10.1117/12.532786
Show Author Affiliations
Ajay Divakaran, Mitsubishi Electric Research Labs. (United States)
Koji Miyahara, Mitsubishi Electric Research Labs. (United States)
Kadir Askin Peker, Mitsubishi Electric Research Labs. (United States)
Regunathan Radhakrishnan, Mitsubishi Electric Research Labs. (United States)
Ziyou Xiong, Mitsubishi Electric Research Labs. (United States)


Published in SPIE Proceedings Vol. 5307:
Storage and Retrieval Methods and Applications for Multimedia 2004
Minerva M. Yeung; Rainer W. Lienhart; Chung-Sheng Li, Editor(s)

© SPIE. Terms of Use
Back to Top