Abstract:Our model, Knowledge Graph‐based Multimodal Neural Network (KGMNN), is designed to process multimodal smart‐grid data including power machine image embeddings, historical defect diagnosis text, image‐to‐item relations, text‐to‐item relations, item‐to‐item spatial relations, machine item embeddings, and labels corresponding to the power machines. The application of artificial intelligence in smart grid operations, particularly for defect detection, has seen remarkable progress. However, effectively leveraging multi‐modal data sources to enhance defect detection performance remains challenging. This paper presents a novel Knowledge Graph‐based Multimodal Neural Network (KGMNN) approach for robust and efficient defect detection in smart grids. Our proposed method first leverages multiple heterogeneous data sources, such as structural data, temporal sensor readings, and maintenance records, creating a comprehensive representation of the grid system. The system is then modeled as a knowledge graph, with nodes representing various entities and edges signifying their interconnections and interactions. This paper introduces a novel neural network architecture that effectively leverages the knowledge graph structure. This architecture incorporates multi‐modal fusion techniques, enabling the model to process and integrate diverse data sources. It can recognize intricate patterns indicative of potential defects that are often undetectable in individual data modes. Experimental results on several real‐world smart grid datasets demonstrate that the KGMNN significantly outperforms state‐of‐the‐art techniques in terms of precision, recall, and computational efficiency. Furthermore, the KGMNN's ability to provide explainable predictions, aided by the inherent interpretability of the knowledge graph structure, is of significant practical value in the field. This research paves the way for a new generation of AI‐powered defect detection in smart grids, facilitating enhanced grid reliability and operational efficiency.

Knowledge Graph Completion for Power Grid Main Equipment Using Pretrained Language Models.

Structure Prompt Augmented Language Model Embedding on Electrical Equipment Defect Knowledge Graph

A lattice LSTM-based framework for knowledge graph construction from power plants maintenance reports

Electrical Equipment Knowledge Graph Embedding Using Language Model with Self-learned Prompts

Automated Equipment Defect Knowledge Graph Construction for Power Grid Regulation

Knowledge graph‐based multimodal neural networks for smart‐grid defect detection

Graph Structure Enhanced Pre-Training Language Model for Knowledge Graph Completion

Do Pre-trained Models Benefit Knowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach.

Knowledge Graph Completion Using Multiple Embedding Representations for Intelligent Information Extraction from Technical Reports.

Simple knowledge graph completion model based on PU learning and prompt learning

Creating Knowledge Graph of Electric Power Equipment Faults Based on BERT–BiLSTM–CRF Model

Multi-perspective Improvement of Knowledge Graph Completion with Large Language Models

Does Pre-trained Language Model Actually Infer Unseen Links in Knowledge Graph Completion?

Power equipment defect prediction based on time series knowledge graph

KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation

A Computational Framework for Effective Representation and Extraction of Knowledge Graph for Power Plant Maintenance and Overhaul.

Fault Diagnosis in Power Grids with Large Language Model

Knowledge Graph Completion for High-Speed Railway Turnout Switch Machine Maintenance Based on the Multi-Level KBGC Model

Pretrained Language–Knowledge Graph Model Benefits Both Knowledge Graph Completion and Industrial Tasks: Taking the Blast Furnace Ironmaking Process as an Example

Power Transformer Fault Prediction Based on Knowledge Graphs