Share Email Print

Proceedings Paper

An adaptive framework for image and video sensing
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Current digital imaging devices often enable the user to capture still frames at a high spatial resolution, or a short video clip at a lower spatial resolution. With bandwidth limitations inherent to any sensor, there is clearly a tradeoff between spatial and temporal sampling rates, which can be studied, and which present-day sensors do not exploit. The fixed sampling rate that is normally used does not capture the scene according to its temporal and spatial content and artifacts such as aliasing and motion blur appear. Moreover, the available bandwidth on the camera transmission or memory is not optimally utilized. In this paper we outline a framework for an adaptive sensor where the spatial and temporal sampling rates are adapted to the scene. The sensor is adjusted to capture the scene with respect to its content. In the adaptation process, the spatial and temporal content of the video sequence are measured to evaluate the required sampling rate. We propose a robust, computationally inexpensive, content measure that works in the spatio-temporal domain as opposed to the traditional frequency domain methods. We show that the measure is accurate and robust in the presence of noise and aliasing. The varying sampling rate stream captures the scene more efficiently and with fewer artifacts such that in a post-processing step an enhanced resolution sequence can be effectively composed or an overall lower bandwidth for the capture of the scene can be realized, with small distortion.

Paper Details

Date Published: 23 February 2005
PDF: 12 pages
Proc. SPIE 5678, Digital Photography, (23 February 2005); doi: 10.1117/12.587417
Show Author Affiliations
Lior Zimet, Univ. of California/Santa Cruz (United States)
Morteza Shahram, Univ. of California/Santa Cruz (United States)
Peyman Milanfar, Univ. of California/Santa Cruz (United States)

Published in SPIE Proceedings Vol. 5678:
Digital Photography
Nitin Sampat; Jeffrey M. DiCarlo; Ricardo J. Motta, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?