Answers are grounded in this paper and cite their sources.
The acquisition of near-infrared (NIR) imagery is crucial for various remote sensing (RS) applications but is often unavailable in remote sensing datasets, providing only the Red-Green-Blue (RGB) bands. Most classical RS workflows rely on NIR information, such as the Normalized Difference Vegetation Index (NDVI) and Normalized Difference Water Index (NDWI), for vegetation and soil monitoring or land cover classification workflows. To overcome this limitation, we introduce NIR-GAN, a conditional generative adversarial network designed to synthesize the NIR band directly from RGB imagery through an image-to-image translation framework. Crucially, the proposed model integrates geographical and climatic context using location embeddings, and incorporates application-specific index-derived loss functions to optimize synthesized outputs for downstream tasks. NIR-GAN enables the generation of partly synthetic datasets, facilitating the training and evaluation of multispectral machine learning models. The developed model demonstrates the capability to generate realistic NIR images from various sources of RS data, regardless of the spatial resolution and spectral characteristics of the sensor, reaching up to 26.6 dB PSNR on Sentinel-2 images. Although synthetic data will never be able to replace the acquisition of real NIR information, this approach can fill the gap in situations where this information would otherwise be absent, including but not limited to the assembly of large-scale training datasets.
No takes yet. Share an insight, caveat, or question.
Donike et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: