Tropical cyclone tracking from geostationary infrared satellite images using deep learning techniques

Accurate tracking of tropical cyclones (TCs) can provide regions of interest for intelligent forecasting of TC tracks and intensity. There have been few studies on algorithms for automatic TC tracking. This study proposes an effective TC tracking method based on deep learning combined with infrared satellite images. The study first constructed a TC tracking dataset based on the infrared images of the China Fengyun-2D geostationary satellite covering six different TC intensity levels between 2009 and 2012. This included 47 complete cases (video sequences) of TCs from generation to extinction. Based on deep learning, the visual tracking algorithm SiamRPN was used as the model framework. Combining Bi-GRU and TC cloud spatiotemporal evolution characteristics to improve the performance of the SiamRPN network, the SiamTCNet target-tracking model was designed to track TCs automatically. Considering that the shape and scale of TC changes with time, a TC is regarded as a typical non-rigid object with obvious timing characteristics, so the first frame of a TC video sequence is combined with the satellite images of the first three frames of the current frame as inputs to the proposed SiamTCNet model, which then extracts the evolution of the TC's spatial structure and its bidirectional temporal change information. The experimental results show that the TC tracking of the proposed model is a significant improvement over the original SiamRPN model.