The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLI-B3
https://doi.org/10.5194/isprs-archives-XLI-B3-487-2016
https://doi.org/10.5194/isprs-archives-XLI-B3-487-2016
09 Jun 2016
 | 09 Jun 2016

A UNIFIED BLENDING FRAMEWORK FOR PANORAMA COMPLETION VIA GRAPH CUTS

Kai Chen, Jian Yao, Menghan Xia, Xinyuan Gui, Xiaohu Lu, and Li Li

Keywords: Image Completion, Panorama, Graph Cuts, Luminance Compensation, Image Blending, Feathering

Abstract. In this paper, we propose a unified framework for efficiently completing streetview and indoor 360° panoramas due to the lack of bottom areas caused by the occlusion of the acquisition platform. To greatly reduce the severe distortion at the bottom of the panorama, we first reproject it onto the ground perspective plane containing the whole occluded region to be completed. Then, we formulate the image completion problem in an improved graph cuts optimization framework based on the statistics of similar patches by strengthening the boundary constraints. To further eliminate image luminance differences and color deviations and conceal geometrical parallax among the optimally selected patches for completion, we creatively apply a multi-bland image blending algorithm for perfect image mosaicking from the completed patches and the originally reprojected image. Finally, we back-project the completed and blended ground perspective image into the cylindrical-projection panorama followed by a simple feathering to further reduce artifacts in the panorama. Experimental results on some representative non-panoramic images and streetview and indoor panoramas demonstrate the efficiency and robustness of the proposed method even in some challenging cases.