Abstract:The min-entropy is a widely used metric to quantify the randomness of generated random numbers in cryptographic applications; it measures the difficulty of guessing the most likely output. An important min-entropy estimator is the compression estimator of NIST Special Publication (SP) 800-90B, which relies on Maurer's universal test. In this paper, we propose two kinds of min-entropy estimators to improve computational complexity and estimation accuracy by leveraging two variations of Maurer's test: Coron's test (for Shannon entropy) and Kim's test (for Rényi entropy). First, we propose a min-entropy estimator based on Coron's test. It is computationally more efficient than the compression estimator while maintaining the estimation accuracy. The secondly proposed estimator relies on Kim's test that computes the Rényi entropy. This estimator improves estimation accuracy as well as computational complexity. We analytically characterize the bias-variance tradeoff, which depends on the order of Rényi entropy. By taking into account this tradeoff, we observe that the order of two is a proper assignment and focus on the min-entropy estimation based on the collision entropy (i.e., Rényi entropy of order two). The min-entropy estimation from the collision entropy can be described by a closed-form solution, whereas both the compression estimator and the proposed estimator based on Coron's test do not have closed-form solutions. By leveraging the closed-form solution, we also propose a lightweight estimator that processes data samples in an online manner. Numerical evaluations demonstrate that the first proposed estimator achieves the same accuracy as the compression estimator with much less computation. The proposed estimator based on the c-llision entropy can even improve the accuracy and reduce the computational complexity.

An Efficient Integrated Nonparametric Entropy Estimator of Serial Dependence

Asymptotic Distribution Theory for Nonparametric Entropy Measures of Serial Dependence

Serial Correlation and Serial Dependence

Generalized spectral tests for serial dependence

Testing for Pairwise Serial Independence Via the Empirical Distribution Function

Testing for Independence Between Two Stationary Time Series Via the Empirical Characteristic Function

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Statistical inference on seemingly unrelated non-parametric regression models with serially correlated errors

Efficient multivariate entropy estimation via $k$-nearest neighbour distances

CHARACTERISTIC FUNCTION BASED TESTING FOR CONDITIONAL INDEPENDENCE: A NONPARAMETRIC REGRESSION APPROACH

Testing for Independence Between Two Covariance Stationary Time Series

Hypothesis Testing in Time Series Via the Empirical Characteristic Function: A Generalized Spectral Density Approach

Simultaneous Testing of the Mean and Variance Structures in Nonlinear Time Series Models

A nonparametric Bayesian test of dependence

Neural Joint Entropy Estimation

Bagging Nearest-Neighbor Prediction Independence Test: an Efficient Method for Nonlinear Dependence of Two Continuous Variables

BET on Independence

Entropy-Based Model Averaging Estimation of Nonparametric Models

Efficient Test for Nonlinear Dependence of Two Continuous Variables

Simultaneous Specification Testing of Mean and Variance Structures in Nonlinear Time Series Regression

On the Efficient Estimation of Min-Entropy