Practical temporal consistency for image-based graphics applications

We present an efficient and simple method for introducing temporal consistency to a large class of optimization driven image-based computer graphics problems. Our method extends recent work in edge-aware filtering, approximating costly global regularization with a fast iterative joint filtering oper...

Full description

Saved in:

Bibliographic Details
Published in:	ACM transactions on graphics 2012-07, Vol.31 (4), p.1-8
Main Authors:	Lang, Manuel, Wang, Oliver, Aydin, Tunc, Smolic, Aljoscha, Gross, Markus
Format:	Article
Language:	eng
Subjects:	Computation Consistency Estimates Filtering Filtration Iterative methods optical flow regularization Shot temporal coherence Temporal logic video
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	We present an efficient and simple method for introducing temporal consistency to a large class of optimization driven image-based computer graphics problems. Our method extends recent work in edge-aware filtering, approximating costly global regularization with a fast iterative joint filtering operation. Using this representation, we can achieve tremendous efficiency gains both in terms of memory requirements and running time. This enables us to process entire shots at once, taking advantage of supporting information that exists across far away frames, something that is difficult with existing approaches due to the computational burden of video data. Our method is able to filter along motion paths using an iterative approach that simultaneously uses and estimates per-pixel optical flow vectors. We demonstrate its utility by creating temporally consistent results for a number of applications including optical flow, disparity estimation, colorization, scribble propagation, sparse data up-sampling, and visual saliency computation.
ISSN:	0730-0301 1557-7368