Temporal difference-guided network for hyperspectral image change detection

ABSTRACTRecently, the research area of hyperspectral (HS) image change detection (CD) is popular with convolutional neural networks (CNNs) based methods. However, conventional CNNs-based CD algorithms commonly achieve detection by comparing the deep features extracted from the bi-temporal images at decision level, which often fails to take full advantage of the features extracted by the network at different levels. Moreover, there are inevitably substantial redundant features located in non-varying regions in bi-temporal images, which considerably impedes the training efficiency of CNNs-based methods. To solve these two problems, we propose a temporal difference-guided HS image CD network, called TDGN Specifically, the rich spectral features will be extracted from the bi-temporal images hierarchically, and then the differences between the two images at different levels of the network will be yielded by the elaborated convolutional gated recurrent unit block in the spatial dimension. Furthermore, the differences from these different levels will be fused for the final detection. More significantly, to boost the efficiency of the backbone network for feature extraction, the obtained difference at each level is also leveraged to generate variation weights to guide the feature extraction at the next stage. Finally, the proposed TDGN can make full use of the temporal difference obtained by the network at different levels while this information is further employed to facilitate the attention and extraction of change features by the network. Extensive experiments, implemented on four well-known HS data sets, demonstrate that the proposed TDGN yields an average overall accuracy of 98. 67%, 96. 74%, 99. 36%, and 96. 81% on these data sets, respectively, acquiring promising detection performance compared to state-of-the-art methods. The codes of this work will be available at https: //github. com/zhonghaochen/TDGNMaster for the sake of reproducibility. KEYWORDS: Hyperspectral (HS) imagechange detection (CD) convolutional neural networks (CNNs) convolutional gated recurrent unittemporal difference-guided AcknowledgementsWe would like to thank the Remote Sensing Laboratory, School of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, for providing the Farmland data set, the NPU for providing River data set, and the CiTIUS for providing the Hermiston data set. Disclosure statementThe authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. Additional informationFundingThis work was supported in part by the National Natural Science Foundation of China under Grant 62071168, in part by the Natural Science Foundation of Jiangsu Province under Grant BK20211201, in part by the China Postdoctoral Science Foundation under Grant 2021M690885, and in part by the National Natural Science Foundation of China under Grant 52069014.