Proposed framework improves anomaly analysis and decision-making in discrete manufacturing using multimodal data.
Multi-source heterogeneous data in discrete manufacturing shop floors, including vibration signals, equipment logs, visual monitoring data, and handwritten production reports, exhibit significant differences in modality and semantic representation. Traditional fusion methods often fail to bridge the semantic gap between low-level sensing signals and high-level manufacturing cognition, limiting intelligent anomaly analysis and decision-making capability. To address this issue, this paper proposes a semantic translation and fusion framework for industrial heterogeneous data based on Knowledge Graph (KG), Retrieval-Augmented Generation (RAG), and Large Language Models (LLMs). First, a unified semantic translation mechanism is developed to convert multimodal industrial data into structured semantic representations for cross-modal alignment. Second, an industrial knowledge graph and RAG mechanism are introduced to integrate process knowledge, maintenance manuals, and historical fault records into the reasoning process. Third, an LLM-driven reasoning framework is designed for multimodal semantic fusion, anomaly identification, causal analysis, and optimization recommendation generation. In addition, a digital twin-based visualization interface is constructed to realize real-time interaction between production lines, industrial data, and intelligent cognitive reports. Experimental results demonstrate that the proposed framework significantly improves industrial reasoning accuracy, anomaly analysis correctness, and response efficiency compared with general-purpose LLMs, providing an effective solution for intelligent cognition and decision-making in discrete manufacturing systems.
No takes yet. Share an insight, caveat, or question.
Zheng et al. (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: