The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLII-2/W4
https://doi.org/10.5194/isprs-archives-XLII-2-W4-83-2017
https://doi.org/10.5194/isprs-archives-XLII-2-W4-83-2017
10 May 2017
 | 10 May 2017

VIDEO COMPLETION IN DIGITAL STABILIZATION TASK USING PSEUDO-PANORAMIC TECHNIQUE

M. N. Favorskaya, V. V. Buryachenko, A. G. Zotin, and A. I. Pakhirka

Keywords: Digital stabilization, Video completion, Motion inpainting, Scene restoration

Abstract. Video completion is a necessary stage after stabilization of a non-stationary video sequence, if it is desirable to make the resolution of the stabilized frames equalled the resolution of the original frames. Usually the cropped stabilized frames lose 10-20% of area that means the worse visibility of the reconstructed scenes. The extension of a view of field may appear due to the pan-tilt-zoom unwanted camera movement. Our approach deals with a preparing of pseudo-panoramic key frame during a stabilization stage as a pre-processing step for the following inpainting. It is based on a multi-layered representation of each frame including the background and objects, moving differently. The proposed algorithm involves four steps, such as the background completion, local motion inpainting, local warping, and seamless blending. Our experiments show that a necessity of a seamless stitching occurs often than a local warping step. Therefore, a seamless blending was investigated in details including four main categories, such as feathering-based, pyramid-based, gradient-based, and optimal seam-based blending.