Abstract:Efficient and valuable strategies provided by large amount of available data are urgently needed for a sustainable electricity system that includes smart grid technologies and very complex power system situations. Big Data technologies including Big Data management and utilization based on increasingly collected data from every component of the power grid are crucial for the successful deployment and monitoring of the system. This paper reviews the key technologies of Big Data management and intelligent machine learning methods for complex power systems. Based on a comprehensive study of power system and Big Data, several challenges are summarized to unlock the potential of Big Data technology in the application of smart grid. This paper proposed a modified and optimized structure of the Big Data processing platform according to the power data sources and different structures. Numerous open-sourced Big Data analytical tools and software are integrated as modules of the analytic engine, and self-developed advanced algorithms are also designed. The proposed framework comprises a data interface, a Big Data management, analytic engine as well as the applications, and display module. To fully investigate the proposed structure, three major applications are introduced: development of power grid topology and parallel computing using CIM files, high-efficiency load-shedding calculation, and power system transmission line tripping analysis using 3D visualization. The real-system cases demonstrate the effectiveness and great potential of the Big Data platform; therefore, data resources can achieve their full potential value for strategies and decision-making for smart grid. The proposed platform can provide a technical solution to the multidisciplinary cooperation of Big Data technology and smart grid monitoring.

Judgment Rules of Big Data Application in Power Industry

Study of the key technologies of electric power big data and its application prospects in smart grid

Application Status and Prospect of Big Data Technology in Smart Grid

An Uniform Access Method of Heterogeneous Big Data with Power Grid Application

A Data Fusion and Data Cleaning System for Smart Grids Big Data.

Key Technologies of Electric Power Big Data and Its Application Prospects in Smart Grid

Application Research of Big Data Real-time Processing Technology in Smart Grid

Electricity Consumption Analysis And Applications Based On Smart Grid Big Data

Research on fault prediction and diagnosis of power equipment based on big data

Big Data Platform for Smart Substation Monitoring System

A Strategy and Architecture Based on Big Data for Power Internet of Things.

Concept, Technology and Challengs of Big Data in Smart Grids

Review of the Basic Technology of Big Data on Analysis and Storage Applied in Power Grids

The Data Mining Under the Dig Data Era and Its Application in Electric Power Enterprises

Analysis of Big Data Technology in Power Distribution System and Typical Applications

Complex Power System Status Monitoring and Evaluation Using Big Data Platform and Machine Learning Algorithms: A Review and a Case Study

Big data analytics in smart grids: state‐of‐the‐art, challenges, opportunities, and future directions

The Application of Big Data Development in Power Engineering Cost

Research on Power Grid Data Asset Management Based on Big Data BI Analysis – The Role of Renewable Energy Technologies

Study on Planning Approach for Big Data Applications in Power Grid Supply Chain

A Study on Power System Development Trend through Comptuer Visualization and Big Data Technology