Abstract:Industrial equipment failure diagnosis is a crucial issue that impacts the national industrial manufacturing level, economic cycle development, and sustainable technological advancement. A multimodal knowledge graph (MMKG) based intelligent diagnostic model for industrial equipment fault is proposed to address the issues of insufficient and inadequate fault data samples encountered when using a single-mode model for fault diagnosis in existing industrial equipment. This model does not require extensive data learning for equipment fault diagnosis in complex industrial scenarios. The model utilizes an improved Faster Regions with CNN features (Faster RCNN) object detection module to extract visual information feature vectors of semi-ordered main and non-main objects. These feature vectors are then mapped to entity, attribute, and relationship vectors in a knowledge graph using cosine similarity for feature correspondence mapping. The semantic matching inference is performed based on this mapping, resulting in a set of fault triplets. Finally, the Bidirectional and Auto-Regressive Transformers (BART) text generation model processes this triplet set to generate fault diagnosis texts. Experimental results demonstrate that the improved Faster RCNN object detection model achieves a 1.2% increase in confidence when trained with small training data sets. The accuracy of generated fault description texts reaches approximately 98% compared to standard texts. The model presented in this paper addresses the challenge of diagnosing faults in industrial equipment, particularly in complex scenarios with limited data, such as substations. It enhances the target detection model to effectively extract visual features even when data is scarce. Additionally, it utilizes an MMKG to enable interpretable intelligent decision-making.

Ontology Driven Modeling of Diagnosis and Maintenance Knowledge for Mechanical Equipment

Intelligent Fault Diagnosis of CNC Machine Tools Based on Rough Set Theory

Fault Diagnosis Of Mechanical Equipment Based On Data Visualization

Mechanical Equipment Fault Diagnosis Driven by Knowledge

Building a Knowledge Base of a Fault Diagnostic System for Chemical Processes

Intelligent Fault Diagnostic Model for Industrial Equipment Based on Multimodal Knowledge Graph

Construction and Reasoning Method of Fault Knowledge Graph with application of Engineering Machinery

IDS-KG: An Industrial Dataspace-based Knowledge Graph Construction Approach for Smart Maintenance

Cases Integration System for Fault Diagnosis of CNC Machine Tools Based on Knowledge Graph

A novel combination belief rule base model for mechanical equipment fault diagnosis

Process fault diagnosis with model- and knowledge-based approaches: Advances and opportunities

Enhancing Fault Troubleshooting through Human-Machine Collaboration: A Multi-Stage Reasoning Approach

Recent Progress on Mechanical Condition Monitoring and Fault Diagnosis

A Practical Approach To The Integrated Expression Of Shallow And Deep Knowledge In Fault Diagnosis Systems

Increasing Interpretability and Feasibility of Data Driven-Based Unknown Fault Diagnosis in Permanent Magnet Synchronous Motors

Research on Fault Diagnosis Expert System of CNC Machine Tool Based on Expert Knowledge

Research on knowledge graph-driven equipment fault diagnosis method for intelligent manufacturing

A Diagnostic Knowledge Model of Wind Turbine Fault.

A Semantic Model-Based Fault Detection Approach for Building Energy Systems

A Survey of Knowledge-Based Intelligent Fault Diagnosis Techniques

Multi-Sensor Fault Diagnosis Based on Time Series in an Intelligent Mechanical System