In-Situ Gaussian Splatting-generated 3D Thermal Mesh Visualization for Urban Trees in Augmented Reality
Keywords: Thermal Infrared (TIR) images, 3D Gaussian Splatting (3DGS), 3D tree modelling, Augmented Reality (AR)
Abstract. Urban trees provide critical ecosystem services in dense city environments, yet current workflows for monitoring their thermal behaviour remain confined to 2D desktop-based analysis with no three-dimensional spatial context or field-deployable visualization capability. This paper presents a complete pipeline for in-situ 3D thermal mesh visualization of urban trees in Augmented Reality (AR), combining Thermal InfraRed (TIR) image acquisition, Gaussian Splatting-based mesh reconstruction, quantitative validation, and mobile AR deployment. TIR images of a Tilia tomentosa acquired with a FLIR T560 camera are preprocessed with a standardized false-colour palette and fed into the MILo (Mesh-In-the-Loop Gaussian Splatting) framework to reconstruct a thermally attributed 3D mesh. Geometric evaluation against a Z+F IMAGER 5016 TLS reference using the M3C2 algorithm demonstrates that MILo recovers 13.5 times more canopy geometry than traditional multi-view stereo under thermal imagery, with a standard deviation of 4.0 cm. A colourmap inversion procedure recovers per-vertex temperature estimates from the GS-derived mesh colours, yielding a mean absolute difference of 0.7°C against direct T-Cam measurements (thermal camera mounted on the laser scanner), within the combined instrument accuracy of both sensors. The resulting thermal Gaussian Splat was deployed in a custom Android AR application supporting hybrid marker-based and GPS-based spatial anchoring for in-situ visualization. These results demonstrate the technical feasibility of GS-based thermal reconstruction and mobile AR as a medium for communicating three-dimensional canopy thermal information to educators and urban forestry practitioners.
