Data mining technology and its application on power system

Zhiwei Liao,Yaming Sun

2001-01-01

Abstract:This paper introduces the development, the implementation method and the application of data mining and summarizes its application in power system at home and abroad. Its future development is also forecasted.

What problem does this paper attempt to address?

A System of Time Series Data Mining Based on Hybrid Model

沈斌,姚敏,温长洋

DOI: https://doi.org/10.3321/j.issn:1000-1964.2003.03.017

2003-01-01

Abstract:Time series data mining is a process of finding previously hidden, unknown but useful information through extracting and dealing with valid historic records from data warehouse. A new time series data mining system based on Gray-Regression-Fuzzy Neural Network hybrid model is proposed and the establishing process of this hybrid model was mainly discussed. This model has been used in forecasting the sustainable development of Zhejiang Province and obtained satisfactory effects. This hybrid model synthesizes the merits of multiple intelligent computation methods and offers a new effective solution of time series data mining.
Application of Data Mining Method based on Deep Learning in Power System

Peng Wang,Fanqi Meng,Guangqiang Qu,Jingdong Wang

DOI: https://doi.org/10.1109/CSNT60213.2024.10545877

2024-04-06

Abstract:As new energy continues to become an important part of the power system, it constitutes a new type of power system with great progress and advantages in power generation and energy consumption. However, due to the uncertainty of new energy, there are many problems in the operation of the new power system. The emergence of data mining technology is able to mine the unknown and hidden information and relationship in the data generated and accumulated by the power system, and achieve the prediction and solution of the problems. In this paper, we will describe the application of data mining technology in the power system, focus on analyzing the application of neural network technology in data mining in the diagnosis of power equipment and new energy output prediction in the new type of power system, and finally summarize the application of data mining technology in the new type of power system and make a future outlook.

Engineering,Environmental Science,Computer Science
Application of Data Mining Technology in Traction Power Supply System of Railway

You He

2003-01-01

Abstract:This paper describes basic principle and method of data mining, and the role in railway power supply system. It proposes correlation steps and methods in mining procedure. These algorithms are of important guiding significance on rationally planning the train running, forecasting the load of power system, diagnosing the faulty facilities.
APPLICATION OF DATA WAREHOUSE AND DATA MINING TECHNIQUES TO POWER SYSTEMS

路广,张伯明,孙宏斌

DOI: https://doi.org/10.3321/j.issn:1000-3673.2001.08.013

2001-01-01

Abstract:A data warehouse is a decision supporting, sub- ject-oriented, assemble, stable and time-dependent collection of data, comparing with data warehouse a data mart is a smaller and centralized one. Data Mining is a data-analyzing and knowledge-acquiring procedure by use of artificial intelli- gence. These new database technologies are introduced in this paper, their application achievements in electric power enter- prises are analyzed, and the current situation and prospect of applying data warehouse and data mart to electric power en- terprises are discussed.
Research And Application Of Operating Monitoring And Evaluation For Dispatching Automation And Control System

Fang Yu,Weijin Zhuang,Mingyang Sun

DOI: https://doi.org/10.1109/imcec.2016.7867495

2016-01-01

Abstract:According to the gradual expansion of power grid scale and rapid development of computer technology, the dispatching automation and control system has played an increasingly prominent role in technique support and guarantee for power grid. In this paper we designed a kind of operating monitoring and evaluation software for the smart grid dispatching and control system, and described several key technologies in detail, which includes index acquisition, data statistical analysis and diagnosis, on-line alarming and interface display. The acquired data is composed of FES information, basic data, application and service status, data consistency, which can fully characterize the operating state of the system and provide accurate and reliable data source. The software has been applied and empirically proved in some dispatching organizations to entrance the operation and maintenance level for the system.
The Data Mining Under the Dig Data Era and Its Application in Electric Power Enterprises

Jingmin Wang,Yinling Li

2015-01-01

Abstract:In this paper,the concept of big data and its widely application in every aspect of social life,as well as the impact on various fields of social life was introduced. This paper introduces the concept of data mining and its application. Finally in this paper, it is stated that the necessity and urgency of the big data analysis of the electric power industry, in the era of big data, also briefly introduces the application of the big data analysis in the electric power enterprise.
Smart Grid Data Mining and Visualization

Yingyao Zhou,Ping Li,Yuning Xiao,Anum Masood,Qichen Yu,Bin Sheng

DOI: https://doi.org/10.1109/pic.2016.7949558

2016-01-01

Abstract:The power industry innovation has increasingly become a top concern for current reforms. Power systems feature scattered data storage, incapable data analysis ability, poor computing capability, and ineffective interaction interface. To resolve these issues, we need multiple data mining techniques to extract information for analytical capacity improvement. Secondly, we need visualization techniques to analyze and optimize interaction. Lastly, we need distributed technologies for unified data management to increase computing capability and system scalability. Considering China's smart grid information, this paper proposes solutions to problems, such as the existing underdeveloped power management systems, a lack of automation methods, low data visualization, and poor data management. The electric power industry has functional requirements for this research. Based on existing data mining, visualization and understanding of distributed technologies, we discussed the functions of each part of the implementation in a smart grid management system: the data mining module, visualization module and data management module.
Data-mining Massive Real-Time Data in a Power Plant: Challenges, Problems and Solutions

Chen Jian-hong,Ren Hao-ren,Sheng De-ren,Li Wei

DOI: https://doi.org/10.1631/jzus.2002.0538

2002-01-01

Journal of Zhejiang University SCIENCE A

Abstract:Nowadays, the scale of data normally stored in a database collected by Data Acquisition System (DAS) or Distributed Control System (DCS) in a power plant is becoming larger and larger. However there are abundant valuable knowledge hidden behind them. It will be beyond people's capacity to analyze and understand these data stored in such a scale database. Fortunately data-mining techniques are arising at the historic moment. In this paper, we explain the basic concept and general knowledge of data-mining; analyze the characteristics and research method of data-mining; give some typical applications of data-mining system based on power plant real-time database on intranct.
Data mining for energy systems: Review and prospect

Wenxuan Liu,Junhua Zhao,Dianhui Wang

DOI: https://doi.org/10.1002/widm.1406

2021-01-01

Abstract:An in-depth study on big data mining is urgently needed for the next-generation energy systems, which are characterized by a deep integration of cyber, physical, and social components. This paper presents an initial discussion on big data mining and its applications in intelligent energy systems. New progress in big data mining, such as deep learning, transfer learning, randomized learning, granular computing, and multisource data fusion, is introduced first. Some applications of data mining in energy systems, such as load forecasting and modeling, integrated power and transportation system, and electricity market forecasting and simulation, are discussed then. Moreover, some research problems in energy system data mining, such as cyber-physical-social system modeling and super-resolution perception for smart meter data, which require further attention in the future, are also discussed. This article is categorized under: Application Areas > Business and Industry
AI Application Fields and Techniques in Power Systems

唐华锦,陈汉平

DOI: https://doi.org/10.3969/j.issn.1005-006X.2001.04.025

2001-01-01

Abstract:The power system problems suitable for AI application are analyzed at first, then AI techniques used on those area are described generally. Finally th e trend of AI application in power system are presented.
A review of data mining technologies in building energy systems: Load prediction, pattern identification, fault detection and diagnosis

Yang Zhao,Chaobo Zhang,Yiwen Zhang,Zihao Wang,Junyang Li

DOI: https://doi.org/10.1016/j.enbenv.2019.11.003

2020-04-01

Energy and Built Environment

Abstract:With the advent of the era of big data, buildings have become not only energy-intensive but also data-intensive. Data mining technologies have been widely utilized to release the values of massive amounts of building operation data with an aim of improving the operation performance of building energy systems. This paper aims at making a comprehensive literature review of the applications of data mining technologies in this domain. In general, data mining technologies can be classified into two categories, i.e., supervised data mining technologies and unsupervised data mining technologies. In this field, supervised data mining technologies are usually utilized for building energy load prediction and fault detection/diagnosis. And unsupervised data mining technologies are usually utilized for building operation pattern identification and fault detection/diagnosis. Comprehensive discussions are made about the strengths and shortcomings of the data mining-based methods. Based on this review, suggestions for future researches are proposed towards effective and efficient data mining solutions for building energy systems.
Data Mining and Machine Learning for Power System Monitoring, Understanding, and Impact Evaluation

Xinda Ke,Huiying Ren,Qiuhua Huang,Pavel Etingov,Zhangshuan Hou

DOI: https://doi.org/10.1002/9781119834052.ch20

2022-01-01

Abstract:This chapter presents results from the Big Data analysis framework to improve power system situational awareness and system reliability. For this purpose, a data set with real-world phasor measurement unit data and historical transmission system outage data has been created and used to carry out the analysis. Several statistical analysis and machine learning methods have been developed and implemented for event and anomaly detection and modeling. Detection and analysis results for actual examples of power system events are presented. Finally, data-driven characterization and risk assessment methods for weather-related extremes in power systems are developed and demonstrated on the Bonneville Power Administration system. These applications demonstrate the capability of machine learning (ML) methods to monitor system abnormalities, to predict system events, and to characterize the impact of extreme events on power grid.
The research and application of data mining in power plant operation optimization

Jian Qiang Li,Ji-Zhen Liu,Cheng-Lin Niu,Luan-Ying Zhang,Jian-Qiang Li

DOI: https://doi.org/10.1109/icmlc.2005.1527208

2005-01-01

Abstract:As the development of electric industry, more and more real-time data are sent to database by DAS and DCS and large amounts of data are accumulated. Abundantly valuable knowledge exists in the history data and it is hard to find and summarize them in traditional way. This paper proposes the operation optimization based on data mining in power plant. The basic structure of the operation optimization based on data mining is established and the fuzzy association rule mining is introduced to find the optimization target value from quantitative values of the equipments in power plant industry process. Based on the history data of a 300MW unit, the optimal values of the operating parameters are found out by data mining techniques. The optimal values are provided to the operators to guide the operation online and the excellent performance is achieved in the power plant.
Application Research on Visual Data Mining Platform in Electricity Power System

LI Jiang,WANG Shao-dong,YANG Bin,XIE Xing-sheng

DOI: https://doi.org/10.3969/j.issn.1671-0320.2007.02.013

2007-01-01

Abstract:Based on the data mining experimental platform,mostly used in electric power industry is VJC-Miner.This paper illustrates the concepts and the software architecture related to the sstem,as well as the technique standards followed by the system,the data mining functionalities and technique feaures of VJC-Miner.In addition,this paper takes examples to introduce the application possibilities of this system applied in electric power system.
Applications of data mining time series to power systems disturbance analysis

Jun Meng,Dan Sun,Zhiyong Li

DOI: https://doi.org/10.1007/11811305_82

2006-01-01

Abstract:In the last decade there has been an explosion of interest in mining time series data, introducing new algorithms to index, classify, cluster and segment time series. In this paper we use fractal theory and reconstructed phase space to analysis the special time series –power systems disturbance signal. After analyzing the feasible method of time series data mining-fractal theory and reconstructed phase space, which is used for the analysis of power disturbance signals. Eight common happed disturbances are considered in this paper, the simulation results show that fractal method can detect the transient disturbance, accurately locate the time when it occurred. Reconstructed phase space can classify the different type of disturbance. It is concluded that two methods are all efficient and intuitionistic for detection and diagnosis the fault of power system, which presents a new concept for power disturbance analysis.
Early Warning of Power Plant Equipment Based on Massive Real-Time Data Mining Technology

Li Kun Zheng,Kun Feng,Xiao Qing Xiao,Wei Qiao Song

DOI: https://doi.org/10.4028/www.scientific.net/amm.599-601.1487

2014-01-01

Applied Mechanics and Materials

Abstract:This paper mainly discusses the application of the mass real-time data mining technology in equipment safety state evaluation in the power plant and the realization of the equipment comprehensive quantitative assessment and early warning of potential failure by mining analysis and modeling massive amounts of real-time data the power equipment. In addition to the foundational technology introduced in this paper, the technology is also verified by the application case in the power supply side remote diagnosis center of Guangdong electric institute.
An Application of Data Mining in District Heating Substations for Improving Energy Performance

Xue Puning,Zhou Zhigang,Chen Xin,Liu Jing

DOI: https://doi.org/10.1051/e3sconf/20172200192

2017-01-01

E3S Web of Conferences

Abstract:Automatic meter reading system is capable of collecting and storing a huge number of district heating (DH) data. However, the data obtained are rarely fully utilized. Data mining is a promising technology to discover potential interesting knowledge from vast data. This paper applies data mining methods to analyse the massive data for improving energy performance of DH substation. The technical approach contains three steps: data selection, cluster analysis and association rule mining (ARM). Two-heating-season data of a substation are used for case study. Cluster analysis identifies six distinct heating patterns based on the primary heat of the substation. ARM reveals that secondary pressure difference and secondary flow rate have a strong correlation. Using the discovered rules, a fault occurring in remote flow meter installed at secondary network is detected accurately. The application demonstrates that data mining techniques can effectively extrapolate potential useful knowledge to better understand substation operation strategies and improve substation energy performance.
Data Science for Energy Systems: Theory, Techniques and Prospect

ZHAO Junhua,DONG Zhaoyang,WEN Fushuan,XUE Yusheng

DOI: https://doi.org/10.7500/AEPS20160813002

2017-01-01

Abstract:The comprehensive energy system,which can coordinate multiple types of energy and be characterized by a deep integration of "cyber-physical-social" systems,is emerging.There is therefore an urgent need to conduct in-depth study on data science and big data mining for energy systems.This paper presents an initial discussion on data science and its applications in comprehensive energy systems.The fundamentals of data science,in particular the importance of the statistical learning theory and data quality,are discussed first.The new progresses in big data mining,such as deep learning,transfer learning and cross domain data fusion,are introduced then.Finally,a brief review is given on the applications of data mining techniques in energy systems;some research problems in energy system data mining,which require further attentions in future,are also discussed.
Practice and Reflection on Data-Driven Modeling in Electric Power Domain

WANG Huifang,YE Ruikai,LUO Bin,ZHANG Bo,WU Xuefeng,LIU Jianmin

DOI: https://doi.org/10.19585/j.zjdl.202210001

2022-01-01

Abstract:Data-driven modeling， with its integrated use of such research paradigms as theory， experiment， and data， as well as its rapid application， will be more widely used for solving new problems in power system technology. To this end， the practice of data-driven modeling in the electric power domain is summarized and reflections concerning this matter are presented. First， data-driven modeling and its application in the electric power domain are presented. Then， the data-driven modeling practice for the poor performance of theoretical modeling is analyzed， and the common procedures in the modeling process are summarized. The practice of data-driven modeling based on power text data and power image data is introduced， and relevant experience and reflections are summarized. Finally， some comprehensions and reflections on the definition， conditions and procedures， advantages， and risks of data-driven modeling in the electric power domain are presented， and some issues on which importance ought to be attached in data-driven modeling in the electric power domain are discussed and summarized.
Data-driven Solutions for Power System Fault Analysis and Novelty Detection.

Ruyuan Han,Qifeng Zhou

DOI: https://doi.org/10.1109/iccse.2016.7581560

2016-01-01

Abstract:With the development of power monitoring technology, more and more real-time data are accumulated in power system. Due to large amount and high dimension of monitoring data, traditional data analysis methods are often unable to discover the hidden rules and complex relationships between monitoring data and fault reasons. In recent years, data mining techniques have been successfully applied in many fields. Compared with traditional statistical methods and commonly used expert system, data-driven based methods also show excellent performance in many fault detection systems. However, most of these methods can only detect the pre-determined faults while ignoring the new emerging ones. And in practice, these new types of power plant failures often result in greater losses. In this paper, we integrate various data mining techniques to analyze the power plant fault and introduce a novelty detection approach. Specifically, Random forest is used to predict power plant fault types and rank important features. Assembling K-means and correlation analysis is applied to further discover the correlation between the faults and features. A new approach RFP, which is proposed in our recent work, is used to discover the new emerging faults. Experiments on a real power plant dataset show that our proposed data-driven approaches can find the important impact factors with plant fault and detect the new emerging fault effectively.

Data mining technology and its application on power system

A System of Time Series Data Mining Based on Hybrid Model

Application of Data Mining Method based on Deep Learning in Power System

Application of Data Mining Technology in Traction Power Supply System of Railway

APPLICATION OF DATA WAREHOUSE AND DATA MINING TECHNIQUES TO POWER SYSTEMS

Research And Application Of Operating Monitoring And Evaluation For Dispatching Automation And Control System

The Data Mining Under the Dig Data Era and Its Application in Electric Power Enterprises

Smart Grid Data Mining and Visualization

Data-mining Massive Real-Time Data in a Power Plant: Challenges, Problems and Solutions

Data mining for energy systems: Review and prospect

AI Application Fields and Techniques in Power Systems

A review of data mining technologies in building energy systems: Load prediction, pattern identification, fault detection and diagnosis

Data Mining and Machine Learning for Power System Monitoring, Understanding, and Impact Evaluation

The research and application of data mining in power plant operation optimization

Application Research on Visual Data Mining Platform in Electricity Power System

Applications of data mining time series to power systems disturbance analysis

Early Warning of Power Plant Equipment Based on Massive Real-Time Data Mining Technology

An Application of Data Mining in District Heating Substations for Improving Energy Performance

Data Science for Energy Systems: Theory, Techniques and Prospect

Practice and Reflection on Data-Driven Modeling in Electric Power Domain

Data-driven Solutions for Power System Fault Analysis and Novelty Detection.