Share Email Print

Proceedings Paper

Using context and similarity for face and location identification
Author(s): Marc Davis; Michael Smith; Fred Stentiford; Adetokunbo Bamidele; John Canny; Nathan Good; Simon King; Rajkumar Janakiraman
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

This paper describes a new approach to the automatic detection of human faces and places depicted in photographs taken on cameraphones. Cameraphones offer a unique opportunity to pursue new approaches to media analysis and management: namely to combine the analysis of automatically gathered contextual metadata with media content analysis to fundamentally improve image content recognition and retrieval. Current approaches to content-based image analysis are not sufficient to enable retrieval of cameraphone photos by high-level semantic concepts, such as who is in the photo or what the photo is actually depicting. In this paper, new methods for determining image similarity are combined with analysis of automatically acquired contextual metadata to substantially improve the performance of face and place recognition algorithms. For faces, we apply Sparse-Factor Analysis (SFA) to both the automatically captured contextual metadata and the results of PCA (Principal Components Analysis) of the photo content to achieve a 60% face recognition accuracy of people depicted in our database of photos, which is 40% better than media analysis alone. For location, grouping visually similar photos using a model of Cognitive Visual Attention (CVA) in conjunction with contextual metadata analysis yields a significant improvement over color histogram and CVA methods alone. We achieve an improvement in location retrieval precision from 30% precision for color histogram and CVA image analysis, to 55% precision using contextual metadata alone, to 67% precision achieved by combining contextual metadata with CVA image analysis. The combination of context and content analysis produces results that can indicate the faces and places depicted in cameraphone photos significantly better than image analysis or context analysis alone. We believe these results indicate the possibilities of a new context-aware paradigm for image analysis.

Paper Details

Date Published: 16 January 2006
PDF: 9 pages
Proc. SPIE 6061, Internet Imaging VII, 60610E (16 January 2006); doi: 10.1117/12.650981
Show Author Affiliations
Marc Davis, Univ. of California, Berkeley (United States)
Michael Smith, France Telecom Research and Development (United States)
Fred Stentiford, Univ. College London (United Kingdom)
Adetokunbo Bamidele, Univ. College London (United Kingdom)
John Canny, Univ. of California, Berkeley (United States)
Nathan Good, Univ. of California, Berkeley (United States)
Simon King, Univ. of California, Berkeley (United States)
Rajkumar Janakiraman, National Univ. of Singapore (Singapore)

Published in SPIE Proceedings Vol. 6061:
Internet Imaging VII
Simone Santini; Raimondo Schettini; Theo Gevers, Editor(s)

© SPIE. Terms of Use
Back to Top