Fault transformer: An automatic fault detection algorithm on seismic images using a transformer enhanced neural network

Seismic fault detection is a key step in seismic interpretation and reservoir characterization that often requires a large amount of human labor and interpretation time. Therefore, automatic seismic fault detection is critical for improving the efficiency of seismic data processing and interpretation. Existing artificial intelligence methods are mostly based on convolutional neural networks with a U-shaped encoder-decoder structure, known as U-net. However, the convolution is limited in modeling long-range correlative features. Instead, transformers, using self-attention mechanisms, avoid the local nature of the convolution, which has the potential to extract long-distance correlations. Transformers are proven to perform well in natural language processing, image classification, and segmentation tasks in precision and recall. Here, we develop a new deep neural network with transformers and a U-net-like structure: a fault transformer to perform the fault detection task. The new network outperforms the traditional U-net in the application with synthetic data sets.