Abstract:We produce a series of results extending information-theoretical inequalities (discussed by Dembo–Cover–Thomas in 1988–1991) to a weighted version of entropy. Most of the resulting inequalities involve the Gaussian weighted entropy; they imply a number of new relations for determinants of positive-definite matrices. Unlike the Shannon entropy where the contribution of an outcome depends only upon its probability, the weighted (or context-dependent) entropy takes into account a ‘value’ of an outcome determined by a given weight function φdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }$$end{document}. An example of a new result is a weighted version of the strong Hadamard inequality (SHI) between the determinants of a positive-definite d×ddocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$d imes d$$end{document} matrix and its square blocks (sub-matrices) of different sizes. When φ≡1documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }equiv 1$$end{document}, the weighted inequality becomes a ‘standard’ SHI; in general, the weighted version requires some assumptions upon φdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }$$end{document}. The SHI and its weighted version generalize a widely known ‘usual’ Hadamard inequality detC≤∏j=1dCjjdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${mathrm{det}},{{mathbf {C}}}le prod olimits _{j=1}^dC_{jj}$$end{document}.

Basic inequalities for weighted entropies

Weighted entropy: basic inequalities

Entropy-power inequality for weighted entropy

Weighted Gaussian entropy and determinant inequalities

Quantum weighted entropy and its properties

Weighted information and weighted entropic inequalities for qutrit and ququart states

Information Theoretic Proofs of Entropy Power Inequalities

Entropy numbers of embedding operators of weighted Sobolev spaces with weights that are functions of distance from some h-set

Worst-cases of distortion riskmetrics and weighted entropy with partial information

Entropy Inequalities and Gaussian Comparisons

A Conditional Entropy Power Inequality for Dependent Variables

Unifying the Brascamp-Lieb Inequality and the Entropy Power Inequality

On relative weighted entropies with central moments weight functions

Equivalence of additive-combinatorial linear inequalities for Shannon entropy and differential entropy

One-Dimensional Discrete Hardy and Rellich Inequalities on Integers

Some inequalities for spectral geometric mean with applications

Inequalities on the essential joint and essential generalized spectral radius

Information Inequalities via Ideas from Additive Combinatorics

Stochastic Order and Generalized Weighted Mean Invariance

A new variant of weighted Hermite-Hadamard inequalities and applications

Entropic uncertainty relations for multiple measurements assigned with biased weights