Abstract:High-dimensional variable selection is an important issue in many scientific fields, such as genomics. In this paper, we develop a sure independence feature screening pro- cedure based on kernel canonical correlation analysis (KCCA-SIS, for short). KCCA- SIS is easy to be implemented and applied. Compared to the sure independence screen- ing procedure based on the Pearson correlation (SIS, for short) developed by Fan and Lv [2008], KCCA-SIS can handle nonlinear dependencies among variables. Compared to the sure independence screening procedure based on the distance correlation (DC- SIS, for short) proposed by Li et al. [2012], KCCA-SIS is scale free, distribution free and has better approximation results based on the universal characteristic of Gaussian Kernel (Micchelli et al. [2006]). KCCA-SIS is more general than SIS and DC-SIS in the sense that SIS and DC-SIS correspond to certain choice of kernels. Compared to supremum of Hilbert Schmidt independence criterion-Sure independence screening (sup-HSIC-SIS, for short) developed by Balasubramanian et al. [2013], KCCA-SIS is scale free removing the marginal variation of features and response variables. No model assumption is needed between response and predictors to apply KCCA-SIS and it can be used in ultrahigh dimensional data analysis. Similar to DC-SIS and sup- HSIC-SIS, KCCA-SIS can also be used directly to screen grouped predictors and for multivariate response variables. We show that KCCA-SIS has the sure screening prop- erty, and has better performance through simulation studies. We applied KCCA-SIS to study Autism genes in a spatiotemporal gene expression dataset for human brain development, and obtained better results based on gene ontology enrichment analysis comparing to the other existing methods.

Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Additive Models

Nonparametric independence screening for ultra-high dimensional generalized varying coefficient models with longitudinal data

Faithful Variable Screening for High-Dimensional Convex Regression

Nonparametric screening for additive quantile regression in ultra-high dimension

Ultrahigh dimensional variable selection: beyond the linear model

Feature Screening via Distance Correlation Learning

Feature Screening for High-Dimensional Variable Selection in Generalized Linear Models

Conditional nonparametric variable screening by neural factor regression

Model-Free Feature Screening for Ultrahigh Dimensional Discriminant Analysis

A robust variable screening procedure for ultra-high dimensional data

Ultrahigh Dimensional Feature Selection via Kernel Canonical Correlation Analysis

Independence-Encouraging Subsampling for Nonparametric Additive Models

A note on marginal correlation based screening

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Robust Sure Independence Screening for Non-polynomial dimensional Generalized Linear Models

Feature Screening for Network Autoregression Model

Forward Regression for Ultra-High Dimensional Variable Screening

Ultrahigh Dimensional Multi-Class Linear Discriminant Analysis by Pairwise Sure Independence Screening

Strong Sure Screening of Ultra-high Dimensional Categorical Data

On the sure screening properties of iteratively sure independence screening algorithms

High-dimensional Ordinary Least-squares Projection for Screening Variables