Share Email Print
cover

Proceedings Paper

Automatic attention-based prioritization of unconstrained video for compression
Author(s): Laurent Itti
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

We apply a biologically-motivated algorithm that selects visually-salient regions of interest in video streams to multiply-foveated video compression. Regions of high encoding priority are selected based on nonlinear integration of low-level visual cues, mimicking processing in primate occipital and posterior parietal cortex. A dynamic foveation filter then blurs (foveates) every frame, increasingly with distance from high-priority regions. Two variants of the model (one with continuously-variable blur proportional to saliency at every pixel, and the other with blur proportional to distance from three independent foveation centers) are validated against eye fixations from 4-6 human observers on 50 video clips (synthetic stimuli, video games, outdoors day and night home video, television newscast, sports, talk-shows, etc). Significant overlap is found between human and algorithmic foveations on every clip with one variant, and on 48 out of 50 clips with the other. Substantial compressed file size reductions by a factor 0.5 on average are obtained for foveated compared to unfoveated clips. These results suggest a general-purpose usefulness of the algorithm in improving compression ratios of unconstrained video.

Paper Details

Date Published: 7 June 2004
PDF: 12 pages
Proc. SPIE 5292, Human Vision and Electronic Imaging IX, (7 June 2004); doi: 10.1117/12.527057
Show Author Affiliations
Laurent Itti, Univ. of Southern California (United States)


Published in SPIE Proceedings Vol. 5292:
Human Vision and Electronic Imaging IX
Bernice E. Rogowitz; Thrasyvoulos N. Pappas, Editor(s)

© SPIE. Terms of Use
Back to Top