Answers are grounded in this paper and cite their sources.
Demonstrates improved solar irradiance forecasting with VISIF, highlighting advances in renewable energy technologies.
Accurate solar forecasting is essential for grid integration but remains challenging due to the stochastic nature of clouds. Despite over a decade of research on machine learning to augment physical forecasting frameworks, progress has been incremental. Recent advances in foundation models have reignited optimism for a step change in solar forecasting. We propose VISIF (Vision-Integrated Solar Irradiance Forecaster), a method that leverages pre-trained large vision–language models for satellite-based solar irradiance forecasting. Rather than assuming that natural image–language alignment transfers directly to satellite remote sensing and ground radiometer data, VISIF adapts a pre-trained LVLM through task-specific interfaces: a modified multi-spectral visual embedding layer, a learnable time-series tokenizer, and a forecasting decoder. The LVLM backbone then serves as a pre-trained multimodal sequence processor for fusing advected satellite imagery with historical ground observations. Experiments across geographically diverse stations show that VISIF consistently outperforms state-of-the-art unimodal and multimodal baselines, reducing the mean absolute error by more than 21% relative to the CrossViViT benchmark. Scaling analysis further indicates that small and mid-sized backbones generalize better across climates. Code is provided for reproducibility. 精准太阳能预报是光伏并网运行的关键,云层动态变化致使预报存在较大不确定性。现有结合机器学习优化物理预测模型的方式提升效果有限,大模型技术为该领域带来全新发展思路。本文提出融合视觉信息的太阳能辐照度预测模型 VISIF,依托预训练大型视觉语言模型,融入卫星遥感影像提升预测精度。该模型针对性设计三个适配模块,实现遥感影像与地面辐照度数据跨模态融合。多站点实测结果证实,该模型性能优于当前最优基准模型,相比 CrossViViT平均绝对误差下降超过 21%。同时,中小规模模型具备更强气候场景泛化能力。相关代码已开源。
No takes yet. Share an insight, caveat, or question.
Zhang et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: