Minor Probability Events’ Detection in Big Data: An Integrated Approach With Bayes Detection and MIM

Shuo Wan,Jiaxun Lu,Pingyi Fan,Khaled Ben Letaief
DOI: https://doi.org/10.1109/LCOMM.2019.2895828
IF: 3.5529
2019-01-01
IEEE Communications Letters
Abstract:In some common scenarios, rare events tend to be more important and worth careful detection. In this case, minor probability event detection rises up as an important issue in big data analytics. With the existence of empirical prior probability distributions of events, one common method to minimize the average detection error is Bayes detection. However, in extreme cases where the prior probability is small, the Bayes method may result in high miss detection rate. To overcome this problem, we proposed a modified detection algorithm by integrating the Bayes method with the message importance measure. Simulation results show that the algorithm significantly reduces the miss detection rate of extremely rare events, which may be helpful to dig rarely occurring phenomenons in big data.
What problem does this paper attempt to address?