Optimal estimation of cloud properties from thermal infrared observations with a combination of deep learning and radiative transfer simulation

Abstract. While traditional thermal infrared retrieval algorithms based on radiative transfer models (RTM) could not effectively retrieve the cloud optical thickness of thick clouds, machine learning based algorithms were found to be able to provide reasonable estimations for both daytime and nighttime. Nevertheless, stand-alone machine learning algorithms are occasionally criticized for the lack of explicit physical processes. In this study, RTM simulations and a machine learning algorithm are synergistically utilized using the optimal estimation (OE) method to retrieve cloud properties from thermal infrared radiometry measured by Moderate Resolution Imaging Spectroradiometer (MODIS). In the new algorithm, retrievals from a machine learning algorithm are used to provide the priori state for OE method, and an RTM is used to create radiance lookup tables that are used in the iteration processes. Compared with stand-alone OE, the cloud properties retrieved by the new algorithm show an overall better performance by optimizing the initial values. Compared with stand-alone machine-learning based algorithm, the radiances simulated based on retrievals from the new method align more closely with observations, and physical radiative processes are handled explicitly in the new algorithm. Therefore, the new method combines the advantages of RTM-based cloud retrieval methods and machine-learning models. These findings highlight the potential for machine-learning-based algorithms to enhance the efficacy of conventional remote sensing techniques.