Image and video retargeting technologies are effective means of resizing media for aspect ratio constrained applications. In this paper, a real-time video retargeting model is proposed for smartphone implementation and potential application to low vision assistance for individuals with tunnel vision. Seam carving is a content-aware retargeting operator which defines 8-connected horizontal or vertical paths, or seams of pixels. The optimality of these seams is based on a specific energy function. Seam removal permits changes in the aspect ratio while simultaneously preserving important regions. This paper introduces a video retargeting model that incorporates spatial and temporal considerations to preserve visual integrity. Face detection masks and salience maps are used to achieve more comprehensive results. Additionally, formulation of a novel temporal coherence measure is presented that allows for retargeting on streaming video in real-time. Integration of the model with a mobile platform emphasizes its portability.

Date Published: 7 March 2013
PDF: 8 pages
Proc. SPIE 8667, Multimedia Content and Mobile Devices, 86670N (7 March 2013); doi: 10.1117/12.2003862

Published in SPIE Proceedings Vol. 8667:
Multimedia Content and Mobile Devices
Reiner Creutzburg; Todor G. Georgiev; Dietmar Wüller; Cees G. M. Snoek; Kevin J. Matherson; David Akopian; Andrew Lumsdaine; Lyndon S. Kennedy, Editor(s)