The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLIII-B1-2020
https://doi.org/10.5194/isprs-archives-XLIII-B1-2020-541-2020
https://doi.org/10.5194/isprs-archives-XLIII-B1-2020-541-2020
06 Aug 2020
 | 06 Aug 2020

INDOOR LIDAR RELOCALIZATION BASED ON DEEP LEARNING USING A 3D MODEL

H. Zhao, D. Acharya, M. Tomko, and K. Khoshelham

Keywords: Relocalization, CNN pose regression, 3D model, Synthetic image, Point cloud, Sensor pose

Abstract. Indoor localization, navigation and mapping systems highly rely on the initial sensor pose information to achieve a high accuracy. Most existing indoor mapping and navigation systems cannot initialize the sensor poses automatically and consequently these systems cannot perform relocalization and recover from a pose estimation failure. For most indoor environments, a map or a 3D model is often available, and can provide useful information for relocalization. This paper presents a novel relocalization method for lidar sensors in indoor environments to estimate the initial lidar pose using a CNN pose regression network trained using a 3D model. A set of synthetic lidar frames are generated from the 3D model with known poses. Each lidar range image is a one-channel range image, used to train the CNN pose regression network from scratch to predict the initial sensor location and orientation. The CNN regression network trained by synthetic range images is used to estimate the poses of the lidar using real range images captured in the indoor environment. The results show that the proposed CNN regression network can learn from synthetic lidar data and estimate the pose of real lidar data with an accuracy of 1.9 m and 8.7 degrees.