Abstract:Reshef & Reshef recently published a paper in which they present a method called the Maximal Information Coefficient (MIC) that can detect all forms of statistical dependence between pairs of variables as sample size goes to infinity. While this method has been praised by some, it has also been criticized for its lack of power in finite samples. We seek to modify MIC so that it has higher power in detecting associations for limited sample sizes. Here we present the Generalized Mean Information Coefficient (GMIC), a generalization of MIC which incorporates a tuning parameter that can be used to modify the complexity of the association favored by the measure. We define GMIC and prove it maintains several key asymptotic properties of MIC. Its increased power over MIC is demonstrated using a simulation of eight different functional relationships at sixty different noise levels. The results are compared to the Pearson correlation, distance correlation, and MIC. Simulation results suggest that while generally GMIC has slightly lower power than the distance correlation measure, it achieves higher power than MIC for many forms of underlying association. For some functional relationships, GMIC surpasses all other statistics calculated. Preliminary results suggest choosing a moderate value of the tuning parameter for GMIC will yield a test that is robust across underlying relationships. GMIC is a promising new method that mitigates the power issues suffered by MIC, at the possible expense of equitability. Nonetheless, distance correlation was in our simulations more powerful for many forms of underlying relationships. At a minimum, this work motivates further consideration of maximal information-based nonparametric exploration (MINE) methods as statistical tests of independence.

Exploratory Analysis of Big Social Data Using MIC/MINE Statistics

Exploratory Analysis for Big Social Data Using Deep Network

Detecting novel multi-variable associations in big data based on MIC

The Generalized Mean Information Coefficient

Analyzing Large Biological Datasets with an Improved Algorithm for MIC

Fast Search Local Extremum for Maximal Information Coefficient (MIC).

Detecting Unbiased Associations in Large Data Sets

SuperMIC: Analyzing Large Biological Datasets in Bioinformatics with Maximal Information Coefficient

Some novel measurement on exploring large data sets based on multi-variables mutual information theory

Analysing Large Biological Data Sets with an Improved Algorithm for MIC.

Comment on" Detecting Novel Associations In Large Data Sets" by Reshef Et Al, Science Dec 16, 2011

A Data Science Solution for Supporting Social and Economic Analysis

Maximal Information Coefficient-Based Testing to Identify Epistasis in Case-Control Association Studies

KM-MIC: an Improved Maximum Information Coefficient Based on K-Medoids Clustering

MetaInsight: Automatic Discovery of Structured Knowledge for Exploratory Data Analysis

Railway Accidents Analysis Based On The Improved Algorithm Of The Maximal Information Coefficient

Equitability Analysis of the Maximal Information Coefficient, with Comparisons

Identifying Multi-Variable Relationships Based on the Maximal Information Coefficient

Bayesian Maximal Information Coefficient (BMIC) to reason novel trends in large datasets

Improved Approximation Algorithm for Maximal Information Coefficient.

MIC-KMeans: A Maximum Information Coefficient Based High-Dimensional Clustering Algorithm.