Abstract:With the increasing penetration of traditional and emerging information technologies in the electric power industry, together with the rapid development of electricity market reform, the electric power industry has accumulated a large amount of data. Data quality issues have become increasingly prominent, which affect the accuracy and effectiveness of electricity data mining and energy big data analytics. It is also closely related to the safety and reliability of the power system operation and management based on data-driven decision support. In this paper, we study the data quality of electricity consumption data in a smart grid environment. First, we analyze the significance of data quality. Also, the definition and classification of data quality issues are explained. Then we analyze the data quality of electricity consumption data and introduce the characteristics of electricity consumption data in a smart grid environment. The data quality issues of electricity consumption data are divided into three types, namely noise data, incomplete data and outlier data. We make a detailed discussion on these three types of data quality issues. In view of that outlier data is one of the most prominent issues in electricity consumption data, so we mainly focus on the outlier detection of electricity consumption data. This paper introduces the causes of electricity consumption outlier data and illustrates the significance of the electricity consumption outlier data from the negative and positive aspects respectively. Finally, the focus of this paper is to provide a review on the detection methods of electricity consumption outlier data. The methods are mainly divided into two categories, namely the data mining-based and the state estimation-based methods.

Data Integrity Research of Power Metering Automation System.

Research on Power Terminal Security Monitoring Method Based on Business Logic Consistency

Design and Implementation of a Wireless Automatic Meter Reading System

A Data Fusion and Data Cleaning System for Smart Grids Big Data.

Safety Monitoring of Power Industrial Control Terminals Based on Data Cleaning

Data Quality Fault Detection,Diagnosis and Recovery in Sub-metering System

Design and Research of Power Information Acquisition System for Smart Grid

Design and Research of Automatic Test Control System for Electric Energy Metering Equipment

Research on Key Technology of State Evaluation and Replacement Acquisition System of Intelligent Electric Energy Meter Based on Smart Grid

Data-Quality Detection and Recovery for Building Energy Management and Control Systems: Case Study on Submetering

Installation,Testing and Defect Eliminating Measures of Electric Energy Data Acquire System

Design of Electric Power Remote Meter Reading System

An Approach for Electric Energy Data Processing Based on Metering Code

Data Quality of Electricity Consumption Data in a Smart Grid Environment

Smart Meter Data Sharing for AI-Enhanced Energy Systems: A Review of Relevant Techniques and Detailed Case Studies

Method for Identifying Abnormal Power Metering Data in Shared Power Information Collection System

Comprehensive Evaluation of Big Data Quality in Power Systems with Entropy Weight and Grey System Theory

Research on Smart Meter Measurement Evaluation Eystem and Establish Real-Time Monitoring Platform

Evaluation And Replacement Of Smart Meters

Data Cleaning for Power Quality Monitoring

Comprehensive Quality Assessment Algorithm for Smart Meters