Automated 3D reconstruction of indoor environments from point clouds has been a topic of intensive research in recent years. Different methods developed for the generation of 3D indoor models have achieved promising results on different case studies. However, a comprehensive evaluation and comparison of the performance of these methods has not been available. This paper presents the preliminary results of the ISPRS benchmark on indoor modelling, an initiative of Working Group IV/5 to benchmark the performance of indoor modelling methods using a public dataset and a comprehensive evaluation framework. The performances of the different methods are compared through geometric quality evaluation of the reconstructed models in terms of completeness, correctness, and accuracy of wall elements. The results show that the reconstruction methods generally achieve high completeness but lower correctness for the reconstructed models while accuracies range from 0.5 cm to 6.7 cm.