Abstract:We produce a series of results extending information-theoretical inequalities (discussed by Dembo–Cover–Thomas in 1988–1991) to a weighted version of entropy. Most of the resulting inequalities involve the Gaussian weighted entropy; they imply a number of new relations for determinants of positive-definite matrices. Unlike the Shannon entropy where the contribution of an outcome depends only upon its probability, the weighted (or context-dependent) entropy takes into account a ‘value’ of an outcome determined by a given weight function φdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }$$end{document}. An example of a new result is a weighted version of the strong Hadamard inequality (SHI) between the determinants of a positive-definite d×ddocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$d imes d$$end{document} matrix and its square blocks (sub-matrices) of different sizes. When φ≡1documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }equiv 1$$end{document}, the weighted inequality becomes a ‘standard’ SHI; in general, the weighted version requires some assumptions upon φdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }$$end{document}. The SHI and its weighted version generalize a widely known ‘usual’ Hadamard inequality detC≤∏j=1dCjjdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${mathrm{det}},{{mathbf {C}}}le prod olimits _{j=1}^dC_{jj}$$end{document}.

Results on the solutions of maximum weighted Renyi entropy problems

Maximum entropy principle for Renyi's and Tsallis' entropies

Uniform Estimate for Maximum of Randomly Weighted Sums with Applications to Ruin Theory

Basic inequalities for weighted entropies

Weighted entropy: basic inequalities

Entropy-power inequality for weighted entropy

Weighted Approach to Rényi Entropy

On relative weighted entropies with central moments weight functions

On the way towards a generalized entropy maximization procedure

On Weighted Residual and Past Entropies

Residual and Past Discrete Tsallis and Renyi Extropy with an Application to Softmax Function

Weighted $p$-Rényi Entropy Power Inequality: Information Theory to Quantum Shannon Theory

On the Completely Monotone Conjecture for Rényi Entropy

A universal approach to Renyi entropy of multiple disjoint intervals

Bernoulli sums and Rényi entropy inequalities

Renyi entropy based design of heavy tailed distribution for return of financial assets

Quantum weighted entropy and its properties

A new approach to weighted Hardy-Rellich inequalities: improvements, symmetrization principle and symmetry breaking

Weighted Gaussian entropy and determinant inequalities

Equivalence of additive-combinatorial linear inequalities for Shannon entropy and differential entropy