Standardized Precipitation Index Forecasting Comparison Using Transformer Models

Accurate long-horizon drought forecasting is essential for water resource management and early warning systems in semi-arid regions. This study evaluates five state-of-the-art Transformer architectures—Vanilla Transformer, Informer, Autoformer, Temporal Fusion Transformer (TFT), and PatchTST—for 24-month forecasting of the Standardized Precipitation Index (SPI-12) across four climatically homogeneous regions of Zacatecas, Mexico (Semi-arid, Highlands, Mountains, and Canyons). Models were trained on monthly precipitation data from 1965–2022 and evaluated on an independent test period (2023–2024) using MAE, RMSE, Pearson correlation, and the Diebold–Mariano test. The results show that PatchTST achieved the best overall performance in three of the four regions, significantly outperforming the other models in most cases. The Vanilla Transformer performed best in the less variable Highlands region. These findings demonstrate that the model’s suitability is strongly dependent on regional climatic characteristics. PatchTST’s patch-based approach proved particularly effective for capturing complex temporal dependencies in highly variable semi-arid environments. This study highlights the potential of Transformer architectures, especially PatchTST, to improve long-horizon SPI forecasting and strengthen operational drought monitoring systems in water-scarce regions.