A SEMANTICALLY ENRICHED MULTIMODAL IMAGING APPROACH DEDICATED TO CONSERVATION AND RESTORATION STUDIES

Abstract. For the past decades, Cultural Heritage (CH) is commonly documented by digital-based imaging and analytical techniques. This documentation is used as a support by heritage scientists to study and help the preservation of CH objects. Multiple techniques or modalities are usually required and applied to complete the documentation and the possible diagnostic from it. In this paper we explored multimodal imaging strategies to survey, analyse and share semantically enriched digital replicas. Three challenging case-studies from the SUMUM research project aims to illustrate efficient multi-source approaches in multi-scalar, multi-temporal and multi-spectral contexts. From multimodal data acquisitions, a photogrammetric-based registration method (TACO) has been developed in order to exploit a 2D/3D semantic annotation process implemented into a CH oriented collaborative web platform (AIOLI). In the exemples showed, the structure and the content of the annotations work is based from condition reports provided by conservation and restoration experts. To this end, all the documentation gathered on CH objects are either directly merged by image based registration while complementary analysis can be spatially anchored to annotations as linked resources. The dissemination part is explored by built-in AIOLI’s collaborative features or external Potree-based viewer, to enhance the accessibility of the final 3D annotated scenes for further expertises or wide-public events and purposes.