Weighted Gaussian entropy and determinant inequalities

I. Stuhl,M. Kelbert,Y. Suhov,S. Yasaei Sekeh

DOI: https://doi.org/10.1007/s00010-021-00861-3

2022-01-22

Aequationes Mathematicae

Abstract:We produce a series of results extending information-theoretical inequalities (discussed by Dembo–Cover–Thomas in 1988–1991) to a weighted version of entropy. Most of the resulting inequalities involve the Gaussian weighted entropy; they imply a number of new relations for determinants of positive-definite matrices. Unlike the Shannon entropy where the contribution of an outcome depends only upon its probability, the weighted (or context-dependent) entropy takes into account a ‘value’ of an outcome determined by a given weight function φdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }$$end{document}. An example of a new result is a weighted version of the strong Hadamard inequality (SHI) between the determinants of a positive-definite d×ddocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$d imes d$$end{document} matrix and its square blocks (sub-matrices) of different sizes. When φ≡1documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }equiv 1$$end{document}, the weighted inequality becomes a ‘standard’ SHI; in general, the weighted version requires some assumptions upon φdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${varphi }$$end{document}. The SHI and its weighted version generalize a widely known ‘usual’ Hadamard inequality detC≤∏j=1dCjjdocumentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$${mathrm{det}},{{mathbf {C}}}le prod olimits _{j=1}^dC_{jj}$$end{document}.

mathematics, applied