The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Publications Copernicus
Articles | Volume XLVIII-2/W4-2024
14 Feb 2024
 | 14 Feb 2024


T. Betsas, A. Georgopoulos, and A. Doulamis

Keywords: 2D instance segmentation, 2D vector drawings, cultural heritage, YOLOv8, orthophotos

Abstract. Orthoimages are a common product used as a base in CAD software for vectorization purposes. In fact, vectorization of orthoimages constitutes a tedious and labour-intensive process which should be supervised by experts e.g. architects, chemical engineers etc. On the one hand, deep learning algorithms are used extensively nowadays achieving high quality results. On the other hand, deep learning algorithms require a huge amount of manually annotated data to be trained on, which is a very difficult process especially at pixel level applications like semantic segmentation and instance segmentation. However, the transformation of 2D CAD drawings into a suitable deep learning dataset (CAD2DLD) is underexplored ignoring a large source of data, created by experts. In this effort, the InCAD algorithm is proposed, which aims to automatically create 2D vector drawings using the YOLOv8 instance segmentation algorithm which was trained on CAD2DLD data. Additionally, a methodology for transforming 2D CAD drawings into a suitable deep learning dataset for instance segmentation, is presented. Finally, the proposed workflow is evaluated on the creation of 2D vector drawings of stones of a fortification wall achieving promising results (78.34 mIoU).