The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLVIII-1-2024
https://doi.org/10.5194/isprs-archives-XLVIII-1-2024-135-2024
https://doi.org/10.5194/isprs-archives-XLVIII-1-2024-135-2024
10 May 2024
 | 10 May 2024

Method for Generating Indoor 3D Scene Graphs Based on Instance Features and Relationship Encoding

Han Du, Benhe Cai, Xiaoming Li, Weixi Wang, and Shengjun Tang

Keywords: Scene Understanding, Deep Learning, Point Cloud, 3D Scene Graph

Abstract. A 3D scene graph is a compact and explicit representation in scene analysis. In today’s 3D scene graph prediction methods, the feature encoding method of nodes and edges is relatively simple, which essentially hinders the network from fully learning 3D point cloud features. In this paper, we propose a 3D scene graph task framework that fully expresses node and edge features, trying to meet the requirements of fully utilizing point cloud features to achieve high-precision prediction. Experimental results show that with the help of the new representation method, the prediction performance of 3D scene graphs has been significantly improved.