This critical review explores the transformative impact of artificial intelligence (AI), particularly machine learning (ML) and computer vision (CV), on scanning electron microscopy (SEM) and energy dispersive spectroscopy (EDS) for metallic microstructure analysis, spanning research from 2010 to 2025. It critically evaluates how AI techniques balance automation, accuracy, and scalability, analysing why certain methods (e.g., Vision Transformers for complex microstructures) excel in specific contexts and how trade-offs in data availability, computational resources, and interpretability shape their adoption. The review examines AI-driven techniques, including semantic segmentation, object detection, and instance segmentation, which automate the identification and characterisation of microstructural features, defects, and inclusions, achieving enhanced accuracy, efficiency, and reproducibility compared to traditional manual methods. It introduces the Microstructure Analysis Spectrum, a novel framework categorising techniques by task complexity and scalability, providing a new lens to understand AI’s role in materials science. The paper also evaluates AI’s role in chemical composition analysis and predictive modelling, facilitating rapid forecasts of mechanical properties such as hardness and fracture strain. Practical applications in steelmaking (e.g., automated inclusion characterisation) and case studies on high-entropy alloys and additively manufactured metals underscore AI’s benefits, including reduced analysis time and improved quality control. Extending prior reviews, this work incorporates recent advancements like Vision Transformers, 3D Convolutional Neural Networks (CNNs), and Generative Adversarial Networks (GANs). Key challenges—data scarcity, model interpretability, and computational demands—are critically analysed, with representative trade-offs from the literature highlighted (e.g., GANs can substantially augment effective dataset size through synthetic data generation, typically at the cost of significantly increased training time).
Abdelal et al. (Sun,) studied this question.