The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLVIII-3-2024
https://doi.org/10.5194/isprs-archives-XLVIII-3-2024-51-2024
https://doi.org/10.5194/isprs-archives-XLVIII-3-2024-51-2024
07 Nov 2024
 | 07 Nov 2024

Generative 3D Reconstruction of Martian Surfaces using Monocular Images

Jiarui Cao, Rong Huang, Zhen Ye, Yusheng Xu, and Xiaohua Tong

Keywords: Mars exploration, Digital terrain model, 3D reconstruction, Generative adversarial network (GAN)

Abstract. High-resolution digital terrain models (DEM) are crucial for Mars scientific exploration and engineering demands, such as mission route planning, landing site selection, and topography research. However, DEMs generated based on photogrammetry or photometry suffer from limited stereo coverage and complex generative processes. Therefore, we propose a GAN-based monocular 3D reconstruction method, which utilizes high-resolution monocular orbital images to achieve pixel-level Martian terrain reconstruction. We preprocess the image data and then invert the elevation using the trained generative model. Finally, we recover the absolute scale through post-processing. In this work, we use HiRISE orthorectified images and DEMs with a resolution of 2 m and 0.25 m to validate the effectiveness of our method. We evaluated our method in four areas with different landforms and found that the predicted DEM and HiRISE DEM have height consistency with the root mean square error of about 2 m. This indicates that the proposed GAN-based method has certain effectiveness and generalization and great potential in high-resolution monocular Martian DEM reconstruction.