PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 2, 2026Pattern Recognition and Image Analysis2 citations

Robust Perception in Degraded Visual Environments: а Multimodal Enhancement Framework

View Full Paper
SHSargis Hovhannisyan

Key Points

  • The aim is to enhance object detection effectiveness in poor visibility conditions using advanced deep learning techniques.
  • Introduced a multimodal enhancement framework consisting of a Red Green Blue dehazing network and a thermal dehazing model.
  • Developed a physics-guided framework for thermal enhancement and a temporal model for consistency in thermal video.
  • Implemented a thermal-to-RGB colorization pipeline to improve visibility in various applications.
  • Validation resulted in up to 100% increase in detectable objects compared to traditional methods.
  • Enhanced detection significantly improved performance under adverse weather conditions.
  • Results indicate robust improvements applicable to fields like wildlife conservation and surveillance.

Abstract

Object detection is a critical component in safety-centric applications like autonomous navigation and remote sensing. However, system efficacy is significantly degraded by adverse weather, with performance dropping by up to 40% in hazy, foggy, or low-light conditions that reduce contrast in both visible (Red Green Blue) and thermal infrared imagery. This performance gap exists because detection models are typically trained on clear-weather data, limiting their real-world reliability. To address this, we introduce a comprehensive enhancement framework that leverages innovative deep learning architectures to improve object detection in challenging visibility. Our research presents a suite of novel neural networks, each targeting a distinct challenge: an end-to-end Red Green Blue dehazing network, a Mamba-based model for thermal dehazing, a physics-guided thermal enhancement framework, a temporal model for thermal video consistency, and a thermal-to-RGB colorization pipeline. Extensive validation confirms our methods' effectiveness, in some cases doubling the number of detectable objects in real-world scenarios. The impact of this work extends to wildlife conservation, surveillance, search and rescue, and medical imaging, providing a foundation for more robust and reliable perception systems.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Sargis Hovhannisyan (2025) studied this question.

synapsesocial.com/papers/69f5939871405d493affe9echttps://doi.org/10.1134/s1054661825700828
Ask AI
Helpful
Bookmark
Share
View Full Paper