SPECTRAL-SPATIAL MULTISCALE RESIDUAL NETWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION

Abstract. In recent years, deep neural networks (DNN) are commonly adopted for hyperspectral image (HSI) classification. As the most representative supervised DNN model, convolutional neural networks (CNNs) have outperformed most algorithms. But the main problem of CNN-based methods lies in the over-smoothing phenomenon. Meanwhile, mainstream methods usually require a large number of samples and a large amount of computation. A multi-task learning spectral-spatial multiscale residual network (SSMRN) is proposed to learn features of objects effectively. In the implementation of the SSMRN, a multiscale residual convolutional neural network (MRCNN) is proposed as spatial feature extractors and a band grouping-based bi-directional gated recurrent unit (Bi-GRU) is utilized as spectral feature extractors. To evaluate the effectiveness of the SSMRN, extensive experiments are conducted on public benchmark data sets. The proposed method can retain the detailed boundary of different objects better and yield a competitive performance compared with two state-of-the-art methods especially when the training samples are inadequate.