Share Email Print

Proceedings Paper

Video frame rate up conversion under inconsistent camera
Author(s): Jinsong Wang; Nilesh Patel; William Grosky
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In this paper, we address the problem of video frame rate up conversion (FRC) in compressed domain. FRC is often recognized as video temporal interpolation. The problem is very challenging when targeted for a video sequence with an inconsistent camera and object motion. A novel compressed domain motion compensation scheme is presented and applied in this paper. The proposed algorithm uses MPEG-2 compressed motion vectors to undergo a cumulative spatiotemporal interpolation over a temporal sliding window of frames. An iterative rejection scheme based on the affine motion model is exploited to detect the global camera motion. Subsequently, the foreground object separation is performed by examining the temporal consistency of the output of iterative rejections. This consistency check process helps to conglomerate the resulting foreground macroblocks and weeds out the unqualified blocks, thus further refines the crude segmentation results. Finally, different strategies for compensating the camera motion and the object motion are applied to interpolate the new frames. Illustrative examples are provided to demonstrate the efficacy of the proposed approach. Experimental results are compared with the popular block based frame interpolation approach.

Paper Details

Date Published: 19 January 2006
PDF: 12 pages
Proc. SPIE 6077, Visual Communications and Image Processing 2006, 60771Z (19 January 2006); doi: 10.1117/12.643338
Show Author Affiliations
Jinsong Wang, Wayne State Univ. (United States)
Nilesh Patel, Univ. of Michigan, Dearborn (United States)
William Grosky, Univ. of Michigan, Dearborn (United States)

Published in SPIE Proceedings Vol. 6077:
Visual Communications and Image Processing 2006
John G. Apostolopoulos; Amir Said, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?