Abstract:Efficient and valuable strategies provided by large amount of available data are urgently needed for a sustainable electricity system that includes smart grid technologies and very complex power system situations. Big Data technologies including Big Data management and utilization based on increasingly collected data from every component of the power grid are crucial for the successful deployment and monitoring of the system. This paper reviews the key technologies of Big Data management and intelligent machine learning methods for complex power systems. Based on a comprehensive study of power system and Big Data, several challenges are summarized to unlock the potential of Big Data technology in the application of smart grid. This paper proposed a modified and optimized structure of the Big Data processing platform according to the power data sources and different structures. Numerous open-sourced Big Data analytical tools and software are integrated as modules of the analytic engine, and self-developed advanced algorithms are also designed. The proposed framework comprises a data interface, a Big Data management, analytic engine as well as the applications, and display module. To fully investigate the proposed structure, three major applications are introduced: development of power grid topology and parallel computing using CIM files, high-efficiency load-shedding calculation, and power system transmission line tripping analysis using 3D visualization. The real-system cases demonstrate the effectiveness and great potential of the Big Data platform; therefore, data resources can achieve their full potential value for strategies and decision-making for smart grid. The proposed platform can provide a technical solution to the multidisciplinary cooperation of Big Data technology and smart grid monitoring.

Research on Key Technology of State Evaluation and Replacement Acquisition System of Intelligent Electric Energy Meter Based on Smart Grid

Evaluation And Replacement Of Smart Meters

Research And Application Of Operating Monitoring And Evaluation For Dispatching Automation And Control System

A Data Fusion and Data Cleaning System for Smart Grids Big Data.

An On-Line State Evaluation Method of Smart Meters Based on Information Fusion

Design and Implementation of a Wireless Automatic Meter Reading System

A Review of Smart Metering for Future Chinese Grids

Complex Power System Status Monitoring and Evaluation Using Big Data Platform and Machine Learning Algorithms: A Review and a Case Study

Comprehensive Quality Assessment Algorithm for Smart Meters

Research on the evolution of smart meter technology

Evaluation Model of Operation State Based on Deep Learning for Smart Meter

Concept, Technology and Challengs of Big Data in Smart Grids

Research on the full life cycle management system of smart electric energy meter

Effectiveness evaluation model of smart substation automation system

Smart Meter Data Sharing for AI-Enhanced Energy Systems: A Review of Relevant Techniques and Detailed Case Studies

A Residential Interactive End-Use Electric System with Electrical Engineering Materials Based on RTP and Load Forecasting

Application Research of Multi-site Smart Substation Based on Digital and Physical Simulation Technology.

Electricity Consumption Analysis And Applications Based On Smart Grid Big Data

Research on Operation Assessment Method for Energy Meter

A Method of Evaluating Operation of Electric Energy Meter

Research On Data Collection Key Technology Of Smart Electric Energy Meters