ISPRS-Archives ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences ISPRS-Archives Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. 2194-9034 Copernicus Publications Göttingen, Germany 10.5194/isprs-archives-XLII-1-W2-1-2019 A REVIEW OF BENCHMARKING IN PHOTOGRAMMETRY AND REMOTE SENSING Bakuła K. 1 4 Mills J. P. 2 4 Remondino F. 3 4 https://orcid.org/0000-0001-6097-5342 Department of Photogrammetry, Remote Sensing and Spatial Information Systems, Faculty of Geodesy and Cartography, Warsaw University of Technology, Warsaw, Poland School of Engineering, Newcastle University, Newcastle upon Tyne, UK 3D Optical Metrology (3DOM), Bruno Kessler Foundation (FBK), Trento, Italy European Spatial Data Research EuroSDR, Leuven, Belgium 12 09 2019 XLII-1/W2 1 8 Copyright: © 2019 K. Bakuła et al. 2019 This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/ This article is available from https://isprs-archives.copernicus.org/articles/isprs-archives-XLII-1-W2-1-2019.html The full text article is available as a PDF file from https://isprs-archives.copernicus.org/articles/isprs-archives-XLII-1-W2-1-2019.pdf

This paper is a preface of the ISPRS/EuroSDR Workshop on the “Evaluation and Benchmarking of Sensors, Systems and Geospatial Data in Photogrammetry and Remote Sensing” that was held in Warsaw University of Technology on 16-17 September 2019. The paper reviews benchmarking in photogrammetry and remote sensing found in the literature relating to geodata. The first part of the paper is a bibliographic analysis based on queries in Scopus and Web of Science databases which shows an increase in research activities based on benchmarking data. In the second part, a review of past and ongoing benchmarking initiatives is presented, providing examples of initiatives within e.g. ISPRS and EuroSDR. The topic of evaluating data, sensors and algorithms with benchmarking activities is interesting as it provides the opportunity to compare, with a unique approach, research results from independent scientists. As hereafter reported, benchmarking has increased in recent years, with many benchmarks being presented in the photogrammetric and remote sensing communities.