Detecting Direct Associations in a Network by Information Theoretic Approaches

Jifan Shi,Juan Zhao,Tiejun Li,Luonan Chen
DOI: https://doi.org/10.1007/s11425-017-9206-0
2018-01-01
Science China Mathematics
Abstract:Detecting direct associations or inferring networks based on the observed data is an important issue in many fields, including biology, physics, engineering and social studies. In this work, we focus on the information theoretic approaches in the network reconstruction or the direct association detection, in particular,for biological networks. We not only review the traditional approaches or measurements on the associations among the observed variables, such as correlation coefficient, mutual information and conditional mutual information(CMI), but also summarize recently developed theories and methods. The new theoretic works include:information geometry to give a unified framework in detecting causality/association, the partial independence to alleviate the singularity of CMI, and multiscale analysis of CMI to avoid the underestimation issue of CMI.The new methods include part mutual information(PMI) and partial associations(PA), which improve the old measurements in avoiding both overestimation and underestimation. All those theories and methods make important contributions as major advances in the development of network inference.
What problem does this paper attempt to address?