Abstract:Efficient and valuable strategies provided by large amount of available data are urgently needed for a sustainable electricity system that includes smart grid technologies and very complex power system situations. Big Data technologies including Big Data management and utilization based on increasingly collected data from every component of the power grid are crucial for the successful deployment and monitoring of the system. This paper reviews the key technologies of Big Data management and intelligent machine learning methods for complex power systems. Based on a comprehensive study of power system and Big Data, several challenges are summarized to unlock the potential of Big Data technology in the application of smart grid. This paper proposed a modified and optimized structure of the Big Data processing platform according to the power data sources and different structures. Numerous open-sourced Big Data analytical tools and software are integrated as modules of the analytic engine, and self-developed advanced algorithms are also designed. The proposed framework comprises a data interface, a Big Data management, analytic engine as well as the applications, and display module. To fully investigate the proposed structure, three major applications are introduced: development of power grid topology and parallel computing using CIM files, high-efficiency load-shedding calculation, and power system transmission line tripping analysis using 3D visualization. The real-system cases demonstrate the effectiveness and great potential of the Big Data platform; therefore, data resources can achieve their full potential value for strategies and decision-making for smart grid. The proposed platform can provide a technical solution to the multidisciplinary cooperation of Big Data technology and smart grid monitoring.

Application of Power Data Mining Within and Between Grid Fields

Application Of Clustering Technologies In Very Large Power Grid Dispatch And Control System

A Data Fusion and Data Cleaning System for Smart Grids Big Data.

Electricity Consumption Analysis And Applications Based On Smart Grid Big Data

Power Grid Missing Data Filling Method Based on Historical Data Mining Assisted Multi-dimensional Scenario Analysis

The Data Mining Under the Dig Data Era and Its Application in Electric Power Enterprises

Application of Data Mining Method based on Deep Learning in Power System

Applying Computational Grid Technology to Power System

Data-mining Massive Real-Time Data in a Power Plant: Challenges, Problems and Solutions

Effectiveness of the Implementation of a Data Mining Algorithm-Based Peak Restriction Method

Study on Planning Approach for Big Data Applications in Power Grid Supply Chain

Practice and Reflection on Data-Driven Modeling in Electric Power Domain

Analysis of Power Grid User Behavior Based on Data Mining Algorithms – System Design and Implementation

Application Research of Big Data Real-time Processing Technology in Smart Grid

Study of Power Grid Development Diagnosis System Based on Multi-Source Data Analysis

APPLICATION OF DATA WAREHOUSE AND DATA MINING TECHNIQUES TO POWER SYSTEMS

Complex Power System Status Monitoring and Evaluation Using Big Data Platform and Machine Learning Algorithms: A Review and a Case Study

COMMUNICATION IN POWER GRID:RESEARCH AND IMPLEMENTATION

Research on Power Grid Data Asset Management Based on Big Data BI Analysis – The Role of Renewable Energy Technologies

Research on Application of Artificial Intelligence Technology in Electrical Automation Control

The research and application of data mining in power plant operation optimization