Evaluation of Convolution Operation Based on the Interpretation of Deep Learning on 3-D Point Cloud

The interpretation of deep learning network is an important part in understanding the convolutional neural networks (CNNs). As an exploratory research, this article explored the interpretation method in 3-D point cloud deep learning networks, for the purpose of evaluating the performance of convolution functions in 3-D point cloud CNNs. Specifically, a 3-D point cloud classification network with two branches is used as the interpretation network in two aspects; 1) information entropy is introduced to diagnose the internal representation in the middle layer of CNN; and 2) the external consistency of convolution function is measured by per-point classification accuracy with class activation mapping technique. Four typical convolution functions are tested by the interpretation network on ModelNet40 dataset and the experimental results demonstrate that the proposed evaluation method is reliable. Feature transformation ability and feature recognition ability of convolution functions are extracted by visualization evaluation and proposed measurable metrics evaluation.