Abstract:This paper mainly focuses on the problem of lossy compression storage based on the data value that represents the subjective assessment of users when the storage size is still not enough after the conventional lossless data compression. To this end, we transform this problem to an optimization, which pursues the least importance-weighted reconstruction error in data reconstruction within limited total storage size, where the importance is adopted to characterize the data value from the viewpoint of users. Based on it, this paper puts forward an optimal allocation strategy in the storage of digital data by the exponential distortion measurement, which can make rational use of all the storage space. In fact, the theoretical results show that it is a kind of restrictive water-filling. It also characterizes the trade-off between the relative weighted reconstruction error and the available storage size. Consequently, if a relatively small part of total data value is allowed to lose, this strategy will improve the performance of data compression. Furthermore, this paper also presents that both the users' preferences and the special characteristics of data distribution can trigger the small-probability event scenarios where only a fraction of data can cover the vast majority of users' interests. Whether it is for one of the reasons above, the data with highly clustered message importance is beneficial to compression storage. In contrast, from the perspective of optimal storage space allocation based on data value, the data with a uniform information distribution is incompressible, which is consistent with that in the information theory.

Non-parametric message important measure: Compressed storage design for big data in wireless communication systems.

Non-Parametric Message Importance Measure: Storage Code Design and Transmission Planning for Big Data

Compressive Massive Random Access for Massive Machine-Type Communications (mMTC).

Measurement and Analysis on the Packet Delivery Performance in A Large Scale Sensor Network

Information Measure Similarity Theory: Message Importance Measure via Shannon Entropy.

Adaptive Data Storage for Querying in Wireless Sensor Networks

Major Coefficients Recovery: A Compressed Data Gathering Scheme for Wireless Sensor Network

Attention to the Variation of Probabilistic Events: Information Processing with Message Importance Measure.

Storage Space Allocation Strategy for Digital Data with Message Importance

State Variation Mining: On Information Divergence with Message Importance in Big Data

Recognizing Information Feature Variation: Message Importance Transfer Measure and Its Applications in Big Data

Differential Message Importance Measure: A New Approach to the Required Sampling Number in Big Data Structure Characterization

1-Bit Compressive Diffusion in Networks Based on Bayesian Inference.

How Many Samples Required in Big Data Collection: A Differential Message Importance Measure.

Energy Efficient Semantic Communication over Wireless Networks with Rate Splitting

A Simple and Effective Data Compress Algorithm in Wireless Sensor Networks

An Electromagnetic Analysis of the Impact of Random Scattering and RISs on the Shannon Capacity of MIMO Communication Systems

A Switch to the Concern of User: Importance Coefficient in Utility Distribution and Message Importance Measure.

An Efficient Lossless Compression Algorithm for Maritime Safety Information Using Byte Encoding Network

Multi-User Probabilistic Semantic Communication with Semantic Compression Ratio Optimization

Resource Allocation for Semantic Relay Aided Wireless Networks with Probability Graph