Abstract:Efficient and valuable strategies provided by large amount of available data are urgently needed for a sustainable electricity system that includes smart grid technologies and very complex power system situations. Big Data technologies including Big Data management and utilization based on increasingly collected data from every component of the power grid are crucial for the successful deployment and monitoring of the system. This paper reviews the key technologies of Big Data management and intelligent machine learning methods for complex power systems. Based on a comprehensive study of power system and Big Data, several challenges are summarized to unlock the potential of Big Data technology in the application of smart grid. This paper proposed a modified and optimized structure of the Big Data processing platform according to the power data sources and different structures. Numerous open-sourced Big Data analytical tools and software are integrated as modules of the analytic engine, and self-developed advanced algorithms are also designed. The proposed framework comprises a data interface, a Big Data management, analytic engine as well as the applications, and display module. To fully investigate the proposed structure, three major applications are introduced: development of power grid topology and parallel computing using CIM files, high-efficiency load-shedding calculation, and power system transmission line tripping analysis using 3D visualization. The real-system cases demonstrate the effectiveness and great potential of the Big Data platform; therefore, data resources can achieve their full potential value for strategies and decision-making for smart grid. The proposed platform can provide a technical solution to the multidisciplinary cooperation of Big Data technology and smart grid monitoring.

Power Big Data and Its Application Scenarios in Power Grid

Concept, Technology and Challengs of Big Data in Smart Grids

Electricity Consumption Analysis And Applications Based On Smart Grid Big Data

A Data Fusion and Data Cleaning System for Smart Grids Big Data.

Application Research of Big Data Real-time Processing Technology in Smart Grid

Big data analytics in smart grids: state‐of‐the‐art, challenges, opportunities, and future directions

The Data Mining Under the Dig Data Era and Its Application in Electric Power Enterprises

A Study on Power System Development Trend through Comptuer Visualization and Big Data Technology

Research on Power Grid Data Asset Management Based on Big Data BI Analysis – The Role of Renewable Energy Technologies

Study on Planning Approach for Big Data Applications in Power Grid Supply Chain

Research progress, trends and prospects of big data technology for new energy power and energy storage system

Research on Architecture of Power Big Data High-Speed Storage System for Energy Interconnection

Big Data Analytics in China's Electric Power Industry: Modern Information, Communication Technologies, and Millions of Smart Meters

Big data driven smart energy management: From big data to big insights

Complex Power System Status Monitoring and Evaluation Using Big Data Platform and Machine Learning Algorithms: A Review and a Case Study

Research on fault prediction and diagnosis of power equipment based on big data

Big Data Application Technology and Prospect Analysis in Smart Distribution Network

Research on digital transformation and application of key business of power grid planning

The Exploration and Application Research of Emerging Technologies in Material Management Business of Large Power Grid Enterprises

A survey on the development status and application prospects of knowledge graph in smart grids

Research on the Status Quo and Problems of Power Grid Production in China