The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLVIII-M-2-2023
https://doi.org/10.5194/isprs-archives-XLVIII-M-2-2023-1051-2023
https://doi.org/10.5194/isprs-archives-XLVIII-M-2-2023-1051-2023
26 Jun 2023
 | 26 Jun 2023

NERF FOR HERITAGE 3D RECONSTRUCTION

G. Mazzacca, A. Karami, S. Rigon, E. M. Farella, P. Trybala, and F. Remondino

Keywords: Neural Radiance Field, Heritage, 3D, Photogrammetry, AI

Abstract. Conventional or learning-based 3D reconstruction methods from images have clearly shown their potential for 3D heritage documentation. Nevertheless, Neural Radiance Field (NeRF) approaches are recently revolutionising the way a scene can be rendered or reconstructed in 3D from a set of oriented images. Therefore the paper wants to review some of the last NeRF methods applied to various cultural heritage datasets collected with smartphone videos, touristic approaches or reflex cameras. Firstly several NeRF methods are evaluated. It turned out that Instant-NGP and Nerfacto methods achieved the best outcomes, outperforming all other methods significantly. Successively qualitative and quantitative analyses are performed on various datasets, revealing the good performances of NeRF methods, in particular for areas with uniform texture or shining surfaces, as well as for small datasets of lost artefacts. This is for sure opening new frontiers for 3D documentation, visualization and communication purposes of digital heritage.