Toward a Trustworthy Classifier With Deep CNN: Uncertainty Estimation Meets Hyperspectral Image

Recently, deep convolutional neural networks (CNNs) have achieved high classification accuracy of hyperspectral image (HSI). However, high accuracy is not the only goal of a good HSI classifier. In real-world applications, it is necessary to tell whether the classifier is certain about its classification result, which is critical for the safe usage. Unfortunately, most of existing models do not consider the issue. In this study, uncertainty is estimated and reduced to build a trustworthy HSI classifier. Firstly, since the output probabilities of softmax layer cannot represent the confidence scores, distance measurement scheme is used to measure the confidence scores. And then, a trustworthy HSI classifier, which reduces the predictive uncertainty in CNN (i.e., PU-CNN), is obtained by minimizing the distance to the correct centroid. Secondly, the fact that a training sample of HSI usually contains many pixel vectors that belong to different classes, which brings label uncertainty. Then, label uncertainty CNN (i.e., LU-CNN), which uses a classifier-consistent estimator to recover the multiple classes in each HSI sample, is proposed. LU-CNN computes loss over candidate label sets to find the optimal classes, which leads to a trustworthy HSI classifier. Finally, the combination of PU-CNN and LU-CNN (i.e., PL-CNN) is proposed to address predictive uncertainty and label uncertainty at the same time. Experimental results on the three popular hyperspectral datasets show that the proposed methods yield improvements in both accuracy and confidence. The proposed trustworthy classifier opens a new window for safe usage of HSI.