A NEW THINKING OF LULC CLASSIFICATION ACCURACY ASSESSMENT
Keywords: Land-Use/Land-Cover (LULC), Accuracy Assessment, Confusion Matrix, Confidence Interval, Bootstrap Resampling
Abstract. A majority of studies involving remote sensing LULC classification conducted classification accuracy assessment without consideration of the training data uncertainty. In this study we present new concepts of LULC classification accuracies, namely the training-sample-based global accuracy and the classifier global accuracy, and a general expression of different measures of classification accuracy in terms of the sample dataset for classifier training and the sample dataset for evaluation of classification results. Through stochastic simulation of a two-feature and two-class case, we demonstrate that the training-sample confusion matrix should replace the commonly adopted reference-sample confusion matrix for evaluation of LULC classification results. We then propose a bootstrap-simulation approach for establishing 95% confidence intervals of classifier global accuracies.