A Convolutional Neural Network Method for Rice Mapping Using Time-Series of Sentinel-1 and Sentinel-2 Imagery

Rice is one of the most essential and strategic food sources globally. Accordingly, policymakers and planners often consider a special place in the agricultural economy and economic development for this essential commodity. Typically, a sample survey is carried out through field observations and farmers’ consultations to estimate annual rice yield. Studies show that these methods lead to many errors and are time-consuming and costly. Satellite remote sensing imagery is widely used in agriculture to provide timely, high-resolution data and analytical capabilities. Earth observations with high spatial and temporal resolution have provided an excellent opportunity for monitoring and mapping crop fields. This study used the time series of dual-pol synthetic aperture radar (SAR) images of Sentinel-1 and multispectral Sentinel-2 images from Sentinel-1 and Sentinel-2 ESA’s Copernicus program to extract rice cultivation areas in Mazandaran province in Iran. A novel multi-channel streams deep feature extraction method was proposed to simultaneously take advantage of SAR and optical imagery. The proposed framework extracts deep features from the time series of NDVI and original SAR images by first and second streams. In contrast, the third stream integrates them into multi-levels (shallow to deep high-level features); it extracts deep features from the channel attention module (CAM), and group dilated convolution. The efficiency of the proposed method was assessed on approximately 129,000 in-situ samples and compared to other state-of-the-art methods. The results showed that combining NDVI time series and SAR data can significantly improve rice-type mapping. Moreover, the proposed methods had high efficiency compared with other methods, with more than 97% overall accuracy. The performance of rice-type mapping based on only time-series SAR images was better than only time-series NDVI datasets. Moreover, the classification performance of the proposed framework in mapping the Shirodi rice type was better than that of the Tarom type.