Answers are grounded in this paper and cite their sources.
Reliable perception in automated vehicles under adverse conditions, such as fog, rain, snow, and lens defocus, is essential for maintaining the safety of road actors and particularly of vulnerable road users. While prior work has primarily focused on camera occlusions, the impact on RADAR and LiDAR remains underexplored, particularly in a unified Bird's Eye View (BEV) space. To address this gap, we first apply occlusion to all three primary sensors: camera, RADAR, and LiDAR, and then systematically investigate its impact by projecting their outputs into the Bird's Eye View (BEV) space for unified analysis of vehicle and map segmentation. A parametrised occlusion pipeline is developed to apply occlusions to each of the sensor modalities. We evaluate both geometry-based and transformer-based fusion architectures, revealing that transformer-based architectures consistently demonstrate greater robustness to sensor degradation. Notably, we demonstrate that BEVCar achieves 45.6% vehicle Intersection-over-Union (IoU) and 53.6% Mean Intersection-over-Union (mIoU) under camera occlusion, surpassing other State-of-the-art (SOTA) models such as MMTraP (37.9% IoU / 47.9% mIoU) and CVT (36.0% IoU / 46.6% mIoU). These improvements are statistically significant (paired t-tests with 95% CI bootstrap,$p < 0.001$). Furthermore, projecting camera features into the BEV space using a backward projection strategy seems to offer greater resilience to occlusion than forward projection. These insights highlight the importance of architectural design, projection choice, and multi-sensor fusion in developing robust perception systems for automated driving under realistic multi-sensor occlusions.
No takes yet. Share an insight, caveat, or question.
Sharma et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: