Abstract:Efficient and valuable strategies provided by large amount of available data are urgently needed for a sustainable electricity system that includes smart grid technologies and very complex power system situations. Big Data technologies including Big Data management and utilization based on increasingly collected data from every component of the power grid are crucial for the successful deployment and monitoring of the system. This paper reviews the key technologies of Big Data management and intelligent machine learning methods for complex power systems. Based on a comprehensive study of power system and Big Data, several challenges are summarized to unlock the potential of Big Data technology in the application of smart grid. This paper proposed a modified and optimized structure of the Big Data processing platform according to the power data sources and different structures. Numerous open-sourced Big Data analytical tools and software are integrated as modules of the analytic engine, and self-developed advanced algorithms are also designed. The proposed framework comprises a data interface, a Big Data management, analytic engine as well as the applications, and display module. To fully investigate the proposed structure, three major applications are introduced: development of power grid topology and parallel computing using CIM files, high-efficiency load-shedding calculation, and power system transmission line tripping analysis using 3D visualization. The real-system cases demonstrate the effectiveness and great potential of the Big Data platform; therefore, data resources can achieve their full potential value for strategies and decision-making for smart grid. The proposed platform can provide a technical solution to the multidisciplinary cooperation of Big Data technology and smart grid monitoring.

Applications of Key Technologies of Storage and Analysis in Electric Power Big Data for Smart Grid

Analysis of Energy Storage Technology for New Power System

Concept, Technology and Challengs of Big Data in Smart Grids

“Smart Grid Plus” research overview

Application Research of Big Data Real-time Processing Technology in Smart Grid

A Data Fusion and Data Cleaning System for Smart Grids Big Data.

Electricity Consumption Analysis And Applications Based On Smart Grid Big Data

Application Of Clustering Technologies In Very Large Power Grid Dispatch And Control System

Distributed storage and processing of real-time data in smart grid dispatching and control systems

Big data analytics in smart grids: state‐of‐the‐art, challenges, opportunities, and future directions

Big data analytics in smart grids: a review

Smart Grid Big Data Analytics: Survey of Technologies, Techniques, and Applications

A Study on Power System Development Trend through Comptuer Visualization and Big Data Technology

Study on Planning Approach for Big Data Applications in Power Grid Supply Chain

Complex Power System Status Monitoring and Evaluation Using Big Data Platform and Machine Learning Algorithms: A Review and a Case Study

Big data driven smart energy management: From big data to big insights

Research on Architecture of Power Big Data High-Speed Storage System for Energy Interconnection

Research progress, trends and prospects of big data technology for new energy power and energy storage system

Research on Key Technology of State Evaluation and Replacement Acquisition System of Intelligent Electric Energy Meter Based on Smart Grid

Build Smart Grids on Artificial Intelligence -- A Real-world Example

Role of IoT technologies in big data management systems: A review and Smart Grid case study