An Application of Estimation-Identification Approach of Multiple Bad Data in Power System State Estimation

ND XIANG,SY WANG,EK YU

DOI: https://doi.org/10.1109/tpas.1984.318221

1984-01-01

IEEE Transactions on Power Apparatus and Systems

Abstract:This paper gives an illustration of the application of The Estimation-Identification Approach (EIA) presented in ref. [1] for a special metering system--The Only-line Metering System (AEP).

What problem does this paper attempt to address?

A New Approach for Detection and Identification of Multiple Bad Data in Power System State Estimation

ND XIANG,SY WANG,EK YU

DOI: https://doi.org/10.1109/mper.1982.5520279

1982-01-01

IEEE Transactions on Power Apparatus and Systems

Abstract:This paper presents a new approach for detection and identification of ultiple bad data --- estimation-identification approach which has been developed in order to improve the performance of static-state estimators of power systems. It describes the important function of detection and identification of bad data which is of crucial importance in designing a static-state estimator as a basic element in power system real-time control; it also discusses tthe basic principle, method of solution and programing technique of so called "Estimation-Identificaition Approach" which is based on the better utilization of the resources of residues and the analysis of the property of its sensitivity matrix; and some test results of simulation on a model system and a practical searching system of doubtful data are given. Test results of identifying bad data is good, it is usually successful especially in the case of the occurence of multi-bad data. At the end of this paper comments concerning the advantages of this approach and its recommendation as a prospective practical approach in real-time applications are given.
Identification Approach to Dynamic Equivalents of the Power System Interconnected with Three Areas

JU Ping,WANG Wei-hua,XIE Hong-jie,ZHOU Hai-qiang

DOI: https://doi.org/10.3321/j.issn:0258-8013.2007.13.006

2007-01-01

Abstract:Dynamic equivalent can reduce the computing effort and manifest the major characteristics. By reason of needing to know system structure and parameters of the equivalent system, coherency method and mode method are mainly used for off-line dynamic equivalent. Therefore identification method is needed for on-line equivalent. In modern power systems, more and more areas are interconnected. It is important to study the identification of multi areas equivalent. For the power systems interconnected with three sub-systems, this paper gives an equivalent model, analyses the identifiability of the model, and uses an evolutionary strategy algorithm for the parameter estimation. It is shown by the case studies of a 36-bus system that the model and the parameter estimation are valid.
A Distributed Maximum-Likelihood-Based State Estimation Approach for Power Systems.

Tengpeng Chen,Yuhao Cao,Xuebing Chen,Lu Sun,Jingrui Zhang,Gehan A. J. Amaratunga

DOI: https://doi.org/10.1109/tim.2020.3024338

IF: 5.6

2020-01-01

IEEE Transactions on Instrumentation and Measurement

Abstract:The distribution of measurement noise is commonly considered as an assumed Gaussian model in power systems, but this assumption is not always true in reality. This article introduces a distributed maximum-likelihood-based state estimation approach for multiarea power systems using the student’s $t$ -distribution measurement noise model. The $t$ -distribution has the property of “thick tail” to better model the occurrence of outliers and is fairly flexible to model different noise statistics. The finite-time average consensus algorithm is utilized in conjunction with an influence function to realize the proposed distributed approach within a totally distributed framework. Based on the local measurement residuals and the limited information exchanged with neighboring areas, each local area can obtain the global optimum system-wide robust state estimates, while the existing distributed state estimation methods can only get local estimates. Moreover, the communication scheme is more flexible and can be totally different from the transmission lines between local areas. Simulations tested on the IEEE 14-bus and 118-bus systems verify the effectiveness of the proposed distributed approach.
A distributed multi-area power system state estimation method based on generalized loss function

Tengpeng Chen,Fangyan Liu,Po Li,Lu Sun,Gehan A. J. Amaratunga

DOI: https://doi.org/10.1088/1361-6501/ace643

IF: 2.398

2023-01-01

Measurement Science and Technology

Abstract:For power system state estimation, the measurement noise is usually assumed to follow the Gaussian distribution, and the widely used estimator is the weighted least squares (WLS). However, the Gaussian distribution assumption is not always true, and the performance of WLS becomes bad when the measurement noise is non-Gaussian. In this paper, a new distributed state estimation (SE) method is proposed for multi-area power systems. The proposed distributed method is based on the generalized loss function so that it can reduce the influence of non-Gaussian noise and bad data. Further, thanks to the matrix-splitting technology, the proposed distributed method can be implemented in a distributed way so that the computation time in each local area can be reduced. The simulation results carried out in the IEEE 30-bus and 118-bus systems verify the robustness and effectiveness of the proposed distributed SE method.
Dynamic State Estimation Method for Generator Considering Measurement of Bad Data

MA Anan,JIANG Quanyuan,XIONG Hongtao,LU Haiqing

DOI: https://doi.org/10.7500/AEPS20160819002

2017-01-01

Abstract:With the wide adoption of phasor measurement unit (PMU) in energy management systems,research on dynamic state estimator for synchronous machine based on PMU is attracting more and more attention.Should there exist bad data,the effect of filtering would be seriously affected.First,an algorithm for dynamic state estimation based on unscented Kalman filter is described.But as the PMU data is of poor quality,to solve problem,the time-varying residual threshold is found by deriving the residual equation.Then,the position of bad data measuring point is determined by an iterative detection method.The corresponding measurement of the bad data is ruled out and repeated for correction of the estimation.Simulation results show that the proposed algorithm can effectively restrain the influence of bad data on state estimation.
An Agent-Based Distributed State Estimation Approach for Interconnected Power Systems

Tengpeng Chen,He Ren,Eddy Y. S. Foo,Po Li,Gehan A. J. Amaratunga

DOI: https://doi.org/10.1109/jsyst.2022.3197426

IF: 4.802

2023-01-01

IEEE Systems Journal

Abstract:Phasor measurement units (PMUs) are becoming more popular in power systems and most of the distributed state estimation methods are based on the Gaussian measurement noise assumption. However, the PMU measurement noise has been demonstrated to be non-Gaussian. This article presents a distributed multiarea state estimation approach based on the quadratic and exponential functions for power systems to deal with the non-Gaussian measurement noise efficiently. The matrix splitting technique is utilized to implement a robust estimator in a fully distributed scheme. Based on the local measurements and the limited information exchanged between neighboring areas, each local area only estimates its local states and the computation time needed is further reduced. The effective and robust performance of the proposed distributed multiarea state estimation approach is demonstrated using the IEEE 30-, 118-, and 300-bus systems.
A Fast and Robust State Estimator Based on Exponential Function for Power Systems

Tengpeng Chen,He Ren,Eddy Y. S. Foo,Lu Sun,Gehan A. J. Amaratunga

DOI: https://doi.org/10.1109/jsen.2022.3143885

IF: 4.3

2022-01-01

IEEE Sensors Journal

Abstract:In realistic power system state estimation, the distribution of measurement noise is usually assumed to be Gaussian while many researcher have verified that it can be non-Gaussian. In this paper, a new robust state estimator based on exponential absolute value function is proposed to address the non-Gaussian measurement noise and outliers. The influence function, a robust statistics tool, is used to obtain the state estimates to reduce its computational burden. A state estimation mean squared error formula of the proposed robust estimator is derived which can be used as a reference in the wide area monitoring system design or upgrade. Simulation results obtained from the IEEE 30-bus, 118-bus and 300-bus systems verify the effectiveness and robustness of the proposed robust estimator.
Power System State Identification Based on Set Theory Estimation Part One Modelling

HE Guangyu,CHANG Naichao,DONG Shufeng,WANG Bin

DOI: https://doi.org/10.7500/AEPS20150529012

2016-01-01

Abstract:As the basis of analysis and control of the power system,state estimation is an important component part of the energy management system.According to the state estimation methods available(including weighted least squares estimation, classical robust estimation and new estimation methods that have sprung up in recent years),this paper analyzes the main problems in current researches.In addition,it is pointed out that the introduction of set theory estimation can not only solve these problems effectively,but improve the credibility of estimation results significantly as well.Then,based on the main idea of set theory estimation,a power system state identifying model is studied.This model can define the relationship between the true state of system and the identification results,ensuring the credibility of the results.Property sets of this model are described mathematically and solution sets based on intervals are proposed,guaranteeing the solvability and applicability of this model.
An overview of different static state estimation techniques with bad data detection, identification and elimination in power system

Lalit Kumar,Pooja K. Kherdikar

DOI: https://doi.org/10.1080/01430750.2021.1874524

2021-02-10

International Journal of Ambient Energy

Abstract:The basic concepts and mathematical models of the power system state estimation along with bad data detection, identification and elimination method are described briefly. Study of the various methodologies and development, regarding the mathematical formulation, numerical solution, computational procedure, measurement types and identification of the modelling errors in the literature, concerning power system static state estimation process, is discussed step by step. The aim of this paper is to provide a comprehensive bibliography on power system static state estimation. The advantages and disadvantages of each method are reviewed and development trends of state estimation are pointed out.
A New State Estimation Method with Bad Data Rejection Properties

Shufeng Dong,Guangyu He,Zuyi Li

DOI: https://doi.org/10.1109/supergen.2009.5348361

2009-01-01

Abstract:A new power system state estimation method with bad data rejection properties is proposed. The method uses a new objective function which a window-likelihood function is used to evaluate each measurement's influence and rejection of failed measurements or measurements whose absolute value of measure error is beyond error limits is a consequences of the objective function form. Power flow equation and zero injection of link bus are considered as constraints in order to improve correctness of state estimation. Mathematical model of the optimization problem is built based on both the new objective function and constraints, and modern inner point algorithm is used to solve the problem. The reason of good performance of bad data rejection of the method is analyzed. The proposed method does not need to perform additional observability analyze, bad data detection, or subjective weighting factors setting, thus substantial reduction in maintenance efforts can be achieved. Numerical simulations are cared out using 4 bus test system, 30, 118 bus test models and a practical utility system. Test results of test system verify that the proposed method has good performance of bad data rejection and archives high good measurement rate in practical system.
Identification of Bad Measurements in Power System from Historical Measurement Data

Wei Chen,Bowen Hu,Yun Wang,Ge Chen,Yadong Zhou

DOI: https://doi.org/10.1109/cac53003.2021.9728365

2021-01-01

Abstract:Bad measurements identification is an important problem for system monitoring and controlling in electric power system. In recent years, some studies have shown that the bad measurements can be corrected by some state estimation methods. However, most of the studies mainly focus on a single measurement snapshot but ignoring the possibility of the continuous measurement errors existence in historical measurement data. In this paper, we propose an algorithm for identification of bad measurements from historical measurements. And considering the different occurrence pattern of bad measurements, we propose a more common situation of bad measurements which is a continuous error in multi-snapshots of measurements rather than a single one. In our method, we use a least-square optimization model as the basic estimator to get the initial results of measurement residuals. After that we set a searching strategy based on hypothesis test and normalized measurement residuals to find a continuous errors in historical measurement data. Then we update the computation of the basic estimator to correct the biases in state variables caused by bad measurements, which lead to more precise results of system states. The performance of the developed identification algorithm is demonstrated and compared with conventional estimation methods based on experiments using IEEE 30-bus systems.
Branch Parameter Error Identification and Estimation in Power Systems

Jianquan Zhu,Feng Liu,Shengwei Mei

DOI: https://doi.org/10.1109/pcspa.2010.127

2010-01-01

Abstract:Branch parameter errors of power systems may deteriorate the accuracy of state estimation (SE) severely, thus, restrain the practical applications of Energy Management Systems (EMS). In order to acquire reliable brunch parameters, a novel estimation approach combined with identification is concerned in this paper. First, the classification and comprehensive assessment method is proposed for parameter errors identification in the case that both the parameter errors and bad data exist. Then, an improved parameter estimation method based on residuals is put forward to eliminate the brunch parameter errors. The numerical stability is also guaranteed fundamentally. The results of the tests carried on the IEEE 300-node system verify the validity of the proposed approaches.
Status quo and prospect of power system state estimation

Bijun Li,Yusheng Xue,Jinwen Gu,Zhenxiang Han

1998-01-01

Abstract:State estimation is an important part of advanced software in modern EMS. This paper reviews the status quo of state estimation. including the principle of state estimation. the application of WLS estimator. disposition of bad data. external network. analysis of observability. optimal measurement placement and the extension of state estimation. Some important problems to be studied further for state estimation are proposed.
A Survey of Power System State Estimation Using Multiple Data Sources: PMUs, SCADA, AMI, and Beyond

Gang Cheng,Yuzhang Lin,Ali Abur,Antonio Gómez-Expósito,Wenchuan Wu

DOI: https://doi.org/10.1109/tsg.2023.3286401

IF: 10.275

2024-01-01

IEEE Transactions on Smart Grid

Abstract:State estimation (SE) is indispensable for the situa-tional awareness of power systems. Conventional SE is fed by measurements collected from the supervisory control and data ac-quisition (SCADA) system. In recent years, available data sources have been greatly enriched with the deployment of phasor meas-urement units (PMUs), advanced metering infrastructure (AMI), intelligent electronic devices (IEDs), etc. The integration of multi-ple data sources provides unprecedented opportunities for en-hancing the performance of SE, but also presents major challenges to resolve, including optimal multi-type-sensor co-placement, mul-tiple reporting rates and asynchronization, diverse types of meas-ured quantities, correlations between measurements, integration of online and historical data sources, and system and measurement uncertainties. This paper outlines the state of the art and research opportunities in this area by providing a comprehensive literature review and extensive discussions. It starts by presenting the moti-vations and challenges, followed by a summary of existing data sources for SE in power systems. Subsequently, for both transmis-sion system (static and dynamic) and distribution system SE, ex-isting methods are systematically reviewed and categorized based on the addressed challenges. Interesting attempts of using novel measurements in SE are also studied. Finally, the paper concludes by providing a detailed discussion on the remaining research gaps and future research directions to be explored.

engineering, electrical & electronic
Distributed Kalman-like Filtering and Bad Data Detection in Large-scale Power System

Jun Yang,Wen-An Zhang,Fanghong Guo

DOI: https://doi.org/10.1109/tii.2021.3119136

IF: 12.3

2021-01-01

IEEE Transactions on Industrial Informatics

Abstract:This article investigates the distributed state estimation problem for large-scale power systems with the appearance of bad data. The power system is decomposed into several nonoverlapping agents and these agents interact with each other through transmission lines to form an interconnected multiagent power system (IMAPS). The measurement at each agent is local measurement, and the measurement in transmission line is edge measurement. To obtain an accurate state estimation of each agent in a distributed manner when the measurements are coupled with bad data, a bad data detection process should be designed. The difficulty is how to detect the bad data in edge measurement in a distributed scheme. To solve this problem, the characteristics of the edge measurement residual is analyzed, and a distributed bad data detection strategy is presented based on a novel iterative distributed Kalman-like filter (IDKF). It is proved that the IDKF algorithm can converge in finite steps when the communication graph of the IMAPS is acyclic, and the estimation accuracy is similar to that of the centralized Kalman filter. In addition, the IDKF algorithm shows excellent performance even when bad data appears. Simulation tests conducted on the IEEE 118-bus power system verify the theoretical findings.

automation & control systems,computer science, interdisciplinary applications,engineering, industrial
A New Method Of Bad Data Detection And Identification In Distribution Networks

Xiaozhong Jiang,Jingjing Yang,Yong Lin,Minghua Chu,Guangyu He,Ninghui Zhou

2015-01-01

Abstract:With the improvement of the quality and reliability of power supply, distribution management systems (DMS) also develop very fast. State estimation of distribution networks is the most basic and essential part of the advanced application functions in distribution networks. However, there are always bad data among measurement data of distribution networks objectively. Detecting and identifying these bad data are of great significance. In this paper, we apply measuring uncertainty to bad data detection and identification in distribution networks. Firstly, the state estimation method based on measuring uncertainty is introduced. Then, the model of bad data detection and identification in distribution networks is established and the calculation methods are discussed. Finally, numerical tests are carried out in three-phase balanced distribution networks and three-phase unbalanced distribution networks.
Bad data detection method for smart grids based on distributed state estimation

Yun Gu,Ting Liu,Dai Wang,Xiaohong Guan,Zhanbo Xu

DOI: https://doi.org/10.1109/ICC.2013.6655273

2013-01-01

Abstract:Bad Data Injection (BDI) in Smart Grid is considered to be the most dangerous cyber attack, as it might lead to energy theft on the end users, false dispatch on the distribution process, and device breakdown on the power generation. State Estimation and Bad Data Detection, which are applied to reduce the observation errors and detect false data in the traditional power grid, could not detect the bad data in smart grid. In this paper, three BDI attack cases in IEEE 14-bus system are designed to bypass the traditional bad data detection. The potential risks on economy and security are analyzed exploiting the MATPOWER. A new method based on Distributed State Estimation (DSE) is proposed to detect BDI, named as DSE-based bad data detection. The power system is divided into several subsystems, and a Chi-squares test is applied to detect the bad data respectively in each subsystem. Simulation results demonstrate that the DSE-based bad data detection can detect all bad data in three attack cases. Moreover, it can locate the bad data in specific subsystem which is helpful for the further identification.
Hybrid Measurements-Based Fast State Estimation for Power Distribution System

Xi He,Chang Li,Mingdi Du,Heng Dong,Peng Li

DOI: https://doi.org/10.1109/access.2021.3055223

IF: 3.9

2021-01-01

IEEE Access

Abstract:The distribution grid is undergoing profound changes nowadays, and state estimator has become an essential part in the control room to enable future smart grid. The newly deployed micro phase measurement units ( $mu $ PMU) and advanced metering infrastructure (AMI) devices make the real-time state estimation possible for distribution system. Therefore, this paper studies the incorporation and process of the multi-source measurements and proposes a fast three-phase state estimation based on the hybrid measurements scheme. By the process of $mu $ PMU measurements, pseudo voltage measurements are added, which significantly increases the estimation redundancy. For AMI measurements, the harmonic components model is used to overcome the asynchronicity problem. An improved sequential state estimation based on the changed measurements is proposed to enable a fast estimation. IEEE 13-node and 390-node systems are simulated to verify the efficacy and efficiency of the proposed method.

computer science, information systems,telecommunications,engineering, electrical & electronic
Analog-Digital Power System State Estimation Based On Information Theory-Part Ii: Implementation And Application

Hongbin Sun,Feng Gao,Kai Strunz,Boming Zhang,Qingxin Li

DOI: https://doi.org/10.1109/TSG.2013.2260362

IF: 10.275

2013-01-01

IEEE Transactions on Smart Grid

Abstract:This paper is the second of a two-part series on analog-digital power system state estimation. The minimum-information-loss (MIL) method that calculates an accurate real-time power system model from a set of analog and digital measurements is implemented, applied, and validated. Two MIL implementations are proposed for both power grid and substation state estimation. The performance of the MIL method is evaluated through three tests. First, the success rate of identifying the true topology is statistically quantified for an IEEE 14-bus system and compared with state-of-the-art generalized state estimation (GSE). Then the competitive performance of the MIL method is further substantiated on two real-world test cases that involve the China Eastern power grid in China and a real substation.
The State Estimation of Power System Parameters based on Data Mining Technology

Li Jide,Peng Shenggang,Wang Chengmin

2012-01-01

Abstract:The false network parameters impair the correctness of state estimation.Parameters,regarded as constants usually,vary along with the status of environment,weather and loads actually.This paper puts forward the grid parameters estimation method based on data mining and estimates the real value of parameters through enormous sample data.Firstly,the SCADA historical data is sorted into kinds of sample ones by cluster analysis technology;Secondly,the outliers,missing value and noise are treated by data processing methods;Finally,the needed grid parameters are estimated through liner regression and the state estimation based on data mining technology is proved to work well in the two calculation examples.

An Application of Estimation-Identification Approach of Multiple Bad Data in Power System State Estimation

A New Approach for Detection and Identification of Multiple Bad Data in Power System State Estimation

Identification Approach to Dynamic Equivalents of the Power System Interconnected with Three Areas

A Distributed Maximum-Likelihood-Based State Estimation Approach for Power Systems.

A distributed multi-area power system state estimation method based on generalized loss function

Dynamic State Estimation Method for Generator Considering Measurement of Bad Data

An Agent-Based Distributed State Estimation Approach for Interconnected Power Systems

A Fast and Robust State Estimator Based on Exponential Function for Power Systems

Power System State Identification Based on Set Theory Estimation Part One Modelling

An overview of different static state estimation techniques with bad data detection, identification and elimination in power system

A New State Estimation Method with Bad Data Rejection Properties

Identification of Bad Measurements in Power System from Historical Measurement Data

Branch Parameter Error Identification and Estimation in Power Systems

Status quo and prospect of power system state estimation

A Survey of Power System State Estimation Using Multiple Data Sources: PMUs, SCADA, AMI, and Beyond

Distributed Kalman-like Filtering and Bad Data Detection in Large-scale Power System

A New Method Of Bad Data Detection And Identification In Distribution Networks

Bad data detection method for smart grids based on distributed state estimation

Hybrid Measurements-Based Fast State Estimation for Power Distribution System

Analog-Digital Power System State Estimation Based On Information Theory-Part Ii: Implementation And Application

The State Estimation of Power System Parameters based on Data Mining Technology