Simulation Research on Anomaly Detection in Large Data Environment

Ya CHEN
DOI: https://doi.org/10.3969/j.issn.1006-9348.2017.09.079
2017-01-01
Abstract:A detection method for abnormal information under big data environment is put forward based on fuzzy clustering.The subset of original data set via sampling data point in the original data set in proportion is formed,and the pretreatment for the observed value of feature of abnormal information is carried out,then the local extreme point of the objective function is searched and characteristic value of sliding window of the pre-detected abnormal information is extracted.The matrix of time-space relationship among neighbor nodes in assigned section is built,and space -time correlation of characteristic value of neighbor nodes is worked out.According to cluster results,the probability of abnormal mutation of information under big data enviromnent is confirmed.Thus,the detection of abnormal information is completed.Simulation resuhs show that the method has high precision.It lays foundation for improving environmental quality of big data.
What problem does this paper attempt to address?