Segmentation and deep learning to digitalize the kinematics of flow-type landslides

Abstract Flow-type landslides, including subaerial and submarine debris flows, have poor spatiotemporal predictability. Therefore, researchers rely heavily on experimental evidence in revealing complex flow mechanisms and evaluating theoretical models. To measure the velocity field of experimental flows, conventional image analysis tools for measuring soil deformation and hydraulics have been borrowed. However, these tools were not developed for capturing the kinematics of fast-moving soil–water mixtures over complex terrain under non-uniform lighting conditions. In this study, a new framework based on deep learning was used to automatically digitalize the kinematics of experimental flow-type landslides. Captured images were broken into sequences and binarized using a fully convolutional neural network (FCNN). The proposed framework was demonstrated to outperform classic image processing algorithms (e.g., particle image velocimetry, trainable Weka segmentation, and thresholding algorithms) over a wide range of experimental conditions. The FCNN model was even able to process images from consumer-grade cameras under complex shadow, light, and boundary conditions. This feature is most useful for field-scale experimentation. With fewer than 15 annotated training images, the FCNN digitalized experimental flows with an accuracy of 97% in semantic segmentation.