Data Cleaning Method of Electromagnetic Environment of Power Transmission Line

Yin FU,Zhanqing YU,Rong ZENG,Lei LIU,Min LI,Chijie ZHUANG
DOI: https://doi.org/10.13336/j.1003-6520.hve.20171227035
2018-01-01
Abstract:In the process of testing electromagnetic environment,outliers in the data sheet always need to clean because of the burst interference occurring in the test environment.Consequently,we studied an automatic data cleaning method of electromagnetic environment with the outliers detection method based on the distance.Considering the test device,the characteristics of data statistics,and the physical characteristics of the electromagnetic environment,we redefined the method of calculating the spatial distance,and put forward the outlier detection clustering.The preprocessing of the electromagnetic environment test data was finished by this method.The results show that outliers have been cleared in the processed database,not changing the statistical features of the data,and the cleaned data are mainly considered as spatial outliers in each subclass.This algorithm can improve the reliability of measurement data.
What problem does this paper attempt to address?