Abstract:The sample size is a fundamental problem in statistics, which also plays a very important role in data collection for big data scenario, especially in the characterization of data structure. This paper considers this problem from the perspective of message importance by transforming the sampling procedure into the process of collecting message importance. To this end, we define differential message importance measure (DMIM) as a measure of message importance for continuous random variable similar to differential entropy and calculate the DMIM for some common distributions. Based on DMIM, this paper proposes a new approach to the required sampling number, where the DMIM deviation is constructed to characterize the process of collecting message importance. In fact, the DMIM deviation is a new criterion to choose sample size to be large enough that the message importance of sample set differs from the whole message importance by no more than the specified amount. In order to visually display that the DMIM deviation can guarantee the statistical performance to some extent, we transformed the difference of message importance into the Kolmogorov-Smirnov statistic. Theoretical analyses and numerical results also demonstrate that the new approach is distribution-free and satisfies the Glivenko-Cantelli theorem, which agrees with the previous results in statistics. Moreover, the connection between message importance and distribution goodness-of-fit is established, which verifies that analyzing the data collection with taking message importance into account is feasible.

Message Importance Measure and Its Application to Minority Subset Detection in Big Data.

Focusing on a Probability Element: Parameter Selection of Message Importance Measure in Big Data

Attention to the Variation of Probabilistic Events: Information Processing with Message Importance Measure.

Information Measure Similarity Theory: Message Importance Measure via Shannon Entropy.

Differential Message Importance Measure: A New Approach to the Required Sampling Number in Big Data Structure Characterization

How Many Samples Required in Big Data Collection: A Differential Message Importance Measure.

Recognizing Information Feature Variation: Message Importance Transfer Measure and Its Applications in Big Data

State Variation Mining: On Information Divergence with Message Importance in Big Data

Non-Parametric Message Importance Measure: Storage Code Design and Transmission Planning for Big Data

Flexible Effective Sample Size Based on the Message Importance Measure

Minor Probability Events’ Detection in Big Data: An Integrated Approach With Bayes Detection and MIM

Importance of Small Probability Events in Big Data: Information Measures, Applications, and Challenges

A Switch to the Concern of User: Importance Coefficient in Utility Distribution and Message Importance Measure.

Amplifying Inter-Message Distance: On Information Divergence Measures in Big Data.

Non-parametric message important measure: Compressed storage design for big data in wireless communication systems.

Feature Selection with Conditional Mutual Information Considering Feature Interaction

MIM-CS: Message Importance Measure for Compressed Sensing

MIM-Based GAN: Information Metric to Amplify Small Probability Events Importance in Generative Adversarial Networks.

Theoretical Analysis of Submodular Information Measures for Targeted Data Subset Selection

Understanding the Traffic Nature of Mobile Instantaneous Messaging in Cellular Networks: A Revisiting to $\alpha $ -Stable Models

MIM-Based Generative Adversarial Networks and Its Application on Anomaly Detection.