Share Email Print

Proceedings Paper

Know your data: understanding implicit usage versus explicit action in video content classification
Author(s): Jude Yew; David A. Shamma
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

In this paper, we present a method for video category classification using only social metadata from websites like YouTube. In place of content analysis, we utilize communicative and social contexts surrounding videos as a means to determine a categorical genre, e.g. Comedy, Music. We hypothesize that video clips belonging to different genre categories would have distinct signatures and patterns that are reflected in their collected metadata. In particular, we define and describe social metadata as usage or action to aid in classification. We trained a Naive Bayes classifier to predict categories from a sample of 1,740 YouTube videos representing the top five genre categories. Using just a small number of the available metadata features, we compare the classifications produced by our Naive Bayes classifier with those provided by the uploader of that particular video. Compared to random predictions with the YouTube data (21% accurate), our classifier attained a mediocre 33% accuracy in predicting video genres. However, we found that the accuracy of our classifier significantly improves by nominal factoring of the explicit data features. By factoring the ratings of the videos in the dataset, the classifier was able to accurately predict the genres of 75% of the videos. We argue that the patterns of social activity found in the metadata are not just meaningful in their own right, but are indicative of the meaning of the shared video content. The results presented by this project represents a first step in investigating the potential meaning and significance of social metadata and its relation to the media experience.

Paper Details

Date Published: 8 February 2011
PDF: 8 pages
Proc. SPIE 7881, Multimedia on Mobile Devices 2011; and Multimedia Content Access: Algorithms and Systems V, 78811A (8 February 2011); doi: 10.1117/12.878807
Show Author Affiliations
Jude Yew, Yahoo! Research (United States)
David A. Shamma, Yahoo! Research (United States)

Published in SPIE Proceedings Vol. 7881:
Multimedia on Mobile Devices 2011; and Multimedia Content Access: Algorithms and Systems V
David Akopian; Cees G. M. Snoek; Nicu Sebe; Reiner Creutzburg; Lyndon Kennedy, Editor(s)

© SPIE. Terms of Use
Back to Top