Abstract:The min-entropy is a widely used metric to quantify the randomness of generated random numbers in cryptographic applications; it measures the difficulty of guessing the most likely output. An important min-entropy estimator is the compression estimator of NIST Special Publication (SP) 800-90B, which relies on Maurer's universal test. In this paper, we propose two kinds of min-entropy estimators to improve computational complexity and estimation accuracy by leveraging two variations of Maurer's test: Coron's test (for Shannon entropy) and Kim's test (for Rényi entropy). First, we propose a min-entropy estimator based on Coron's test. It is computationally more efficient than the compression estimator while maintaining the estimation accuracy. The secondly proposed estimator relies on Kim's test that computes the Rényi entropy. This estimator improves estimation accuracy as well as computational complexity. We analytically characterize the bias-variance tradeoff, which depends on the order of Rényi entropy. By taking into account this tradeoff, we observe that the order of two is a proper assignment and focus on the min-entropy estimation based on the collision entropy (i.e., Rényi entropy of order two). The min-entropy estimation from the collision entropy can be described by a closed-form solution, whereas both the compression estimator and the proposed estimator based on Coron's test do not have closed-form solutions. By leveraging the closed-form solution, we also propose a lightweight estimator that processes data samples in an online manner. Numerical evaluations demonstrate that the first proposed estimator achieves the same accuracy as the compression estimator with much less computation. The proposed estimator based on the c-llision entropy can even improve the accuracy and reduce the computational complexity.

CONTAMINATION RATE ESTIMATION BASED ON ENTROPY

Entropy Estimation of Contaminated Normal Distribution

Nonparametric Estimation for Contamination Distribution

An Improved Belief Entropy and Its Application in Decision-Making

Entropy Models of Trip Distribution

Minimum Total Error Entropy Method for Parameter Estimation

Entropy Estimation via Uniformization

Bayesian Reliability Estimation for Deteriorating Systems with Limited Samples Using the Maximum Entropy Approach.

Comparison of Conventional Deterministic and Entropy-Based Methods for Predicting Sediment Concentration in Debris Flow

Estimating Information Entropy for Hydrological Data: One‐dimensional Case

Entropy and Probability Distributions

On Entropy Estimation of Inverse Weibull Distribution under Improved Adaptive Progressively Type-II Censoring with Applications

How and in What Sense Can the Entropy Be Measured?

Modelling the spreading rate of controlled communicable epidemics through an entropy-based thermodynamic model

Tractable and Near-Optimal Adversarial Algorithms for Robust Estimation in Contaminated Gaussian Models

Statistical inference of entropy functions of generalized inverse exponential model under progressive type-II censoring test

Analysis on Generalized Entropy Principle Based on Risk Aversion Degree

Entropy-Based Method to Evaluate the Data Integrity

A Very Efficient Scheme for Estimating Entropy of Data Streams Using Compressed Counting

On the Efficient Estimation of Min-Entropy

Entropy Estimate for Degenerate SDEs with Applications to Nonlinear Kinetic Fokker-Planck Equations