Share Email Print

Proceedings Paper

Can relative skill be determined from a photographic portfolio?
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In this study, our primary aim is to determine empirically the role that skill plays in determining image aesthetics, and whether it can be deciphered from the ratings given by a diverse group of judges. To this end, we have collected and analyzed data from a large number of subjects (total 168) on a set of 221 of images taken by 33 photographers having different photographic skill and experience. We also experimented with the rating scales used by previous studies in this domain by introducing a binary rating system for collecting judges’ opinions. The study also demonstrates the use of Amazon Mechanical Turk as a crowd-sourcing platform in collecting scientific data and evaluating the skill of the judges participating in the experiment. We use a variety of performance and correlation metrics to evaluate the consistency of ratings across different rating scales and compare our findings. A novel feature of our study is an attempt to define a threshold based on the consistency of ratings when judges rate duplicate images. Our conclusion deviates from earlier findings and our own expectations, with ratings not being able to determine skill levels of photographers to a statistically significant level.

Paper Details

Date Published: 14 March 2013
PDF: 10 pages
Proc. SPIE 8651, Human Vision and Electronic Imaging XVIII, 86510X (14 March 2013); doi: 10.1117/12.2008065
Show Author Affiliations
Abhishek Agrawal, Nanyang Technological Univ. (Singapore)
Vittal Premachandran, Nanyang Technological Univ. (Singapore)
Rajesh Somavarapu, The Univ. of Texas at Dallas (United States)
Ramakrishna Kakarala, Nanyang Technological Univ. (Singapore)

Published in SPIE Proceedings Vol. 8651:
Human Vision and Electronic Imaging XVIII
Bernice E. Rogowitz; Thrasyvoulos N. Pappas; Huib de Ridder, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?