Answers are grounded in this paper and cite their sources.
Coded aperture snapshot spectral imaging (CASSI) enables snapshot acquisition of hyperspectral image (HSI) by compressing a three-dimensional spectral data into a single two-dimensional measurement. While recent learning-based reconstruction methods achieve impressive performance on simulated datasets, their performance often degrades significantly on real CASSI systems, revealing a simulation-to-reality gap. This gap arises from a mismatch between the complex real imaging process and the reconstruction mappings learned from idealized simulated data. To bridge this simulation-to-reality gap, we propose a learnable physics-informed forward model (LPFM) that incorporates the physical structure of CASSI into a learnable proxy network to model the complex real imaging process. To train the LPFM, we construct the first real-world spectral compressive imaging (rSCI) dataset. The rSCI dataset contains 219 pairs of static HSI-CASSI images across diverse indoor and outdoor scenes, as well as additional dynamic CASSI videos. Leveraging rSCI and LPFM, we establish the first real-world benchmark for CASSI reconstruction. Extensive experiments demonstrate that incorporating data generated by LPFM effectively reduces the simulation-to-reality gap and consistently improves reconstruction performance across various state-of-the-art methods.
No takes yet. Share an insight, caveat, or question.
Wang et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: