Abstract:We produce a series of results extending information-theoretical inequalities (discussed by Dembo–Cover–Thomas in 1988–1991) to a weighted version of entropy. Most of the resulting inequalities involve the Gaussian weighted entropy; they imply a number of new relations for determinants of positive-definite matrices. Unlike the Shannon entropy where the contribution of an outcome depends only upon its probability, the weighted (or context-dependent) entropy takes into account a ‘value’ of an outcome determined by a given weight function φdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }$$end{document}. An example of a new result is a weighted version of the strong Hadamard inequality (SHI) between the determinants of a positive-definite d×ddocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$d imes d$$end{document} matrix and its square blocks (sub-matrices) of different sizes. When φ≡1documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }equiv 1$$end{document}, the weighted inequality becomes a ‘standard’ SHI; in general, the weighted version requires some assumptions upon φdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }$$end{document}. The SHI and its weighted version generalize a widely known ‘usual’ Hadamard inequality detC≤∏j=1dCjjdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${mathrm{det}},{{mathbf {C}}}le prod olimits _{j=1}^dC_{jj}$$end{document}.

Weighted entropy: basic inequalities

Basic inequalities for weighted entropies

Entropy-power inequality for weighted entropy

Weighted Gaussian entropy and determinant inequalities

Quantum weighted entropy and its properties

Information Theoretic Proofs of Entropy Power Inequalities

Weighted information and weighted entropic inequalities for qutrit and ququart states

Worst-cases of distortion riskmetrics and weighted entropy with partial information

Weighted $p$-Rényi Entropy Power Inequality: Information Theory to Quantum Shannon Theory

A Conditional Entropy Power Inequality for Dependent Variables

Entropy numbers of embedding operators of weighted Sobolev spaces with weights that are functions of distance from some h-set

On Weighted Residual and Past Entropies

An Information-Theoretic Foundation for the Weighted Updating Model

Comment on "Stronger subadditivity of entropy" by Lieb and Seiringer <a class="link-https" data-arxiv-id="math-ph/0412009" href="https://arxiv.org/abs/math-ph/0412009">math-ph/0412009</a>

Weighted Approach to Rényi Entropy

Unifying the Brascamp-Lieb Inequality and the Entropy Power Inequality

On Weighted Extropies

On some entropy inequalities

Properties of the Shannon, Rényi and other entropies: dependence in parameters, robustness in distributions and extremes

Novel Inequalities for Generalized Graph Entropies Revisited, Graph Energies and Topological Indices

Entropy Inequalities and Gaussian Comparisons