PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 14, 2026Scientific Reports0 citationsOpen Access

TinyML pipeline for efficient crack classification in UAV-based structural health inspections

YZYuxuan ZhangANArne NürnbergLRLuciano Sebastian Martinez Rau

Key Points

  • To develop a self-contained TinyML pipeline for efficient crack classification using UAV technology.
  • Utilized STM32H7 microcontroller for onboard inference
  • Compared two preprocessing strategies for image input
  • Evaluated four compression techniques for model optimization
  • Measured performance through F1-score and resource usage metrics
  • Achieved an F1-score of 0.938, outperforming previous methods by 11.4%
  • Reduced latency to 461.6 ms and energy cost to 623.16 mJ per inference
  • Required only 2.9 MB RAM and 309 KB flash memory
  • Minimized flight time reduction to 1.31 minutes (4%) when using the optimized pipeline

Abstract

Structural health monitoring (SHM) of civil, aerospace, and energy infrastructure increasingly relies on UAVs with vision sensors for efficient inspections. Crack classification is a central task, yet cloud-based inference introduces bandwidth, power, connectivity, and privacy challenges that limit its practicality. This study presents a fully self-contained Tiny Machine Learning (TinyML) pipeline for onboard crack classification on a milliwatt-level STM32H7 microcontroller. Using MobileNetV1x0.25 as the baseline, we systematically evaluate the full measurement pipeline, including image capture, preprocessing, and inference on a low-power embedded system. Two preprocessing strategies, a handcrafted sequence (grayscale, contrast, denoise, median, binarization) and a greedy algorithm-based composite method, are compared. Four compression techniques, namely post-training quantization (PTQ), quantization-aware training (QAT), pruning, and weight clustering, are assessed individually and in combination. The optimized pipeline achieves an F1-score of 0.938, an improvement of 11.4% over state-of-the-art deployments. At the same time, it requires only 2.9 MB RAM and 309 KB flash, with an end-to-end latency of 461.6 ms and an energy cost of 623.16 mJ per inference. On a DJI Mini 4 Pro UAV, continuous operation reduces flight time by just 1.31 minutes (4%), compared to 8 minutes (24%) when using Jetson-based platforms. Overall, this work delivers a reproducible benchmark for UAV-based SHM, demonstrating a practical balance of accuracy, resource efficiency, and energy consumption, and advancing the feasibility of on-device crack classification in highly resource-constrained environments.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Zhang et al. (2026) studied this question.

synapsesocial.com/papers/69b4fbf9b39f7826a300c8b0https://doi.org/10.1038/s41598-026-43534-4
Ask AI
Helpful
Bookmark
Share
View Full Paper