Video inpainting of occluding and occluded objects
Patwardhan, K.A.
Sapiro, G.
Bertalmio, M.
Minnesota Univ., Minneapolis, MN, USA;
This paper appears in: Image Processing, 2005. ICIP 2005. IEEE International Conference on
Publication Date: 11-14 Sept. 2005
Volume: 2,
On page(s): II- 69-72
ISBN: 0-7803-9134-9
INSPEC Accession Number: 8835878
Digital Object Identifier: 10.1109/ICIP.2005.1529993
Current Version Published: 2005-11-14
Abstract
We present a basic technique to fill-in missing parts of a video sequence taken from a static camera. Two important cases are considered. The first case is concerned with the removal of non-stationary objects that occlude stationary background. We use a priority based spatio-temporal synthesis scheme for inpainting the stationary background. The second and more difficult case involves filling-in moving objects when they are partially occluded. For this, we propose a priority scheme to first inpaint the occluded moving objects and then fill-in the remaining area with stationary background using the method proposed for the first case. We use as input an optical-flow based mask, which tells if an undamaged pixel is moving or is stationary. The moving object is inpainted by copying patches from undamaged frames, and this copying is independent of the background of the moving object in either frame. This work has applications in a variety of different areas, including video special effects and restoration and enhancement of damaged videos. The examples shown in the paper illustrate these ideas.
Index
Terms
Available to subscribers and IEEE members.
References
Available to subscribers and IEEE members.
Citing Documents
Available to subscribers and IEEE members.
Cart
