The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLVIII-4-2024
https://doi.org/10.5194/isprs-archives-XLVIII-4-2024-337-2024
https://doi.org/10.5194/isprs-archives-XLVIII-4-2024-337-2024
21 Oct 2024
 | 21 Oct 2024

AI upscaling Supporting Image Alignment in Photogrammetric Reconstruction

Alessandro Martinelli, Agnese Toni, and Sara Brescia

Keywords: AI, Photogrammetry, Upscaling, Survey, Sharpening, Resolution

Abstract. This research aims to investigate and analyze the contribution provided by preventive image processing using AI in the SfM data acquisition process. Specifically, the objective is to observe qualities and defects of "AI upscaling" integrated into the normal workflow of digital restitution, with the hypothesis that greater sharpness and resolution can lead to better alignments and better model generations. Other similar experiments have been carried out previously on the AI intervention in the photos to improve the alignments, but a generic procedure and with untrained public AI has not yet been experimented. In the first phase of the research, the most suitable AI upscaling method for the purpose is selected, processing example images and comparing them with the original and various settings of the AI parameters to maintain likeness. In the second phase, the procedure efficiency was evaluated in several ways: through the automatic evaluation of Agisoft Metashape's Image Quality, by directly comparing the resulting model with the standard digital reconstruction of the same objects, comparing with a model produced with the native AI upscaling of the return program, and finally comparing with a high-level survey without defects. This test was repeated for four case studies specifically diversified by several factors, including subject scale, level of detail, lighting, color, blur, and type of camera used. Clear improvements emerge in all cases of AI upscaling, even reaching successful reconstructions that would not have started with the canonical method. It can therefore be stated that this preventive upscaling procedure is decisive in cases of low quality or damaged datasets, while in cases of already qualitatively sufficient photos it can be a useful support for increasing the level of detail.