Abstract:We produce a series of results extending information-theoretical inequalities (discussed by Dembo–Cover–Thomas in 1988–1991) to a weighted version of entropy. Most of the resulting inequalities involve the Gaussian weighted entropy; they imply a number of new relations for determinants of positive-definite matrices. Unlike the Shannon entropy where the contribution of an outcome depends only upon its probability, the weighted (or context-dependent) entropy takes into account a ‘value’ of an outcome determined by a given weight function φdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }$$end{document}. An example of a new result is a weighted version of the strong Hadamard inequality (SHI) between the determinants of a positive-definite d×ddocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$d imes d$$end{document} matrix and its square blocks (sub-matrices) of different sizes. When φ≡1documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }equiv 1$$end{document}, the weighted inequality becomes a ‘standard’ SHI; in general, the weighted version requires some assumptions upon φdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }$$end{document}. The SHI and its weighted version generalize a widely known ‘usual’ Hadamard inequality detC≤∏j=1dCjjdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${mathrm{det}},{{mathbf {C}}}le prod olimits _{j=1}^dC_{jj}$$end{document}.

Entropy Inequalities and Gaussian Comparisons

Unifying the Brascamp-Lieb Inequality and the Entropy Power Inequality

Weighted Gaussian entropy and determinant inequalities

On some inequalities for Gaussian measures

The entropic doubling constant and robustness of Gaussian codebooks for additive-noise channels

A generalization of Costa's Entropy Power Inequality

On entropy Marton-type inequalities and small symmetric differences with cosets of abelian groups

On some entropy inequalities

Error Bounds on a Mixed Entropy Inequality

Basic inequalities for weighted entropies

Equivalence of additive-combinatorial linear inequalities for Shannon entropy and differential entropy

Operator Entropy Inequalities

Information-Theoretic Perspectives on Brascamp-Lieb Inequality and Its Reverse

Information Theoretic Proofs of Entropy Power Inequalities

New Brunn--Minkowski and functional inequalities via convexity of entropy

A comparison inequality for sums of independent random variables

Convex comparison of Gaussian mixtures

Gaussian inequality

Stability for the Brunn-Minkowski and Riesz Rearrangement Inequalities, with Applications to Gaussian Concentration and Finite Range Non-local Isoperimetry

Thinning, photonic beamsplitting, and a general discrete entropy power inequality

The subadditivity of quantum entropy in Gaussian quantum systems