Evaluating Model Robustness for Defect Identification and Classification in a Composite Aerostructure Material

Abstract Aircraft structures are required to have a high level of quality to satisfy their need for light weight, efficient flight, and withstanding high loads over their lifespan. These aerostructures are typically made from a composite material due to their good tensile strength and resistance to compression. To ensure their structural integrity, the composite material requires inspection for common flaws such as porosity, delaminations, voids, foreign object debris, and other defects. Ultrasonic testing (UT) is a popular non-destructive inspection (NDI) technique used for effectively evaluating the composite material. Current inspection methods rely heavily on human experience and are extremely time consuming. Therefore, there is a need for the development of techniques to reduce the manual inspection time. This work compares the performance of different deep learning-based methods in the identification and classification of defects. Deep learning has shown great promise in numerous fields, and we show its effectiveness in the evaluation of the composite aerostructure material. The methods developed here are both highly reliable with a top recall value of 98.64% as well as extremely efficient requiring an average of 4 s during the inferencing stage to evaluate new composites. Finally, we investigate model robustness to concept drift by measuring its performance over time.