Advancing Cockpit Safety: Cost-Effective Flight Data Monitoring with Deep Learning

The rotorcraft community faces significantly higher accident rates compared to fixed-wing commercial aircraft, underscoring the critical need for enhanced safety measures. While Helicopter Flight Data Monitoring programs hold promise in improving safety, their widespread adoption remains limited, partly due to challenges associated with the acquisition and analysis of flight data. This paper proposes a Deep Learning (DL) solution to address safety concerns within the rotorcraft community by efficiently acquiring and analyzing flight data for a more automated and comprehensive safety assessment. Specifically, we leverage data obtained with cost-effective off-the-shelf cameras, and process it through Convolutional Neural Networks for automated detection and classification of gauges from several helicopters' cockpits. Our DL pipeline integrates a classifier for helicopter identification, an object detector for cockpit gauges detection and classification, and a network to infer the reading of each detected gauge. The contribution of this work is two-fold: (1) enhance rotorcraft safety by developing a DL framework capable of detecting, classifying, and inferring gauge readings for different helicopter types, and (2) boost research in the field by constructing a curated dataset valuable for aviation and machine learning communities.