Abstract:The complete characterization of the almost-entropic region yields rate regions for network coding problems. However, this characterization is difficult and open. In this paper, we propose a novel algorithm to determine whether an arbitrary vector in the entropy space is entropic or not, by parameterizing and generating probability mass functions by neural networks. Given a target vector, the algorithm minimizes the normalized distance between the target vector and the generated entropic vector by training the neural network. The algorithm reveals the entropic nature of the target vector, and obtains the underlying distribution, accordingly. The proposed algorithm was further implemented with convolutional neural networks, which naturally fit the structure of joint probability mass functions, and accelerate the algorithm with GPUs. Empirical results demonstrate improved normalized distances and convergence performances compared with prior works. We also conducted optimizations of the Ingleton score and Ingleton violation index, where a new lower bound of the Ingleton violation index was obtained. An inner bound of the almost-entropic region with four random variables was constructed with the proposed method, presenting the current best inner bound measured by the volume ratio. The potential of a computer-aided approach to construct achievable schemes for network coding problems using the proposed method is discussed.

A New Distribution on the Simplex with Auto-Encoding Applications

Stabilizing the Kumaraswamy Distribution

Distributionally Robust Optimization with Correlated Data from Vector Autoregressive Processes

Debiased Distribution Compression

A Stein Gradient Descent Approach for Doubly Intractable Distributions

A new infinitely divisible discrete distribution with applications to count data modeling

Convex optimization over a probability simplex

Distributionally Robust Skeleton Learning of Discrete Bayesian Networks

On Simplices with a Given Barycenter That Are Enclosed by the Standard Simplex

K-Deep Simplex: Deep Manifold Learning via Local Dictionaries

The alchemy of probability distributions: beyond Gram-Charlier expansions, and a skew-kurtotic-normal distribution from a rank transmutation map

A new robust class of skew elliptical distributions

Label Distribution Learning using the Squared Neural Family on the Probability Simplex

A New Generalized Kumaraswamy Distribution

On an Absolute Autoregressive Model and Skew Symmetric Distributions

A Proof of the Weak Simplex Conjecture

Optimizing Distributions for Associated Entropic Vectors via Generative Convolutional Neural Networks

A Distributionally Robust Approach to Shannon Limits using the Wasserstein Distance

Distributionally Robust Prescriptive Analytics with Wasserstein Distance

Jacobi-Style Iteration for Distributed Submodular Maximization

A New Class of Symmetric Distributions Including the Elliptically Symmetric Logistic