Abstract:Feature selection from a large number of covariates (aka features) in a regression analysis remains a challenge in data science, especially in terms of its potential of scaling to ever-enlarging data and finding a group of scientifically meaningful features. For example, to develop new, responsive drug targets for ovarian cancer, the actual false discovery rate (FDR) of a practical feature selection procedure must also match the target FDR. The popular approach to feature selection, when true features are sparse, is to use a penalized likelihood or a shrinkage estimation, such as a LASSO, SCAD, Elastic Net, or MCP procedure (call them benchmark procedures). We present a different approach using a new subsampling method, called the Subsampling Winner algorithm (SWA). The central idea of SWA is analogous to that used for the selection of US national merit scholars. SWA uses a "base procedure" to analyze each of the subsamples, computes the scores of all features according to the performance of each feature from all subsample analyses, obtains the "semifinalist" based on the resulting scores, and then determines the "finalists," i.e., the most important features. Due to its subsampling nature, SWA can scale to data of any dimension in principle. The SWA also has the best-controlled actual FDR in comparison with the benchmark procedures and the randomForest, while having a competitive true-feature discovery rate. We also suggest practical add-on strategies to SWA with or without a penalized benchmark procedure to further assure the chance of "true" discovery. Our application of SWA to the ovarian serous cystadenocarcinoma specimens from the Broad Institute revealed functionally important genes and pathways, which we verified by additional genomics tools. This second-stage investigation is essential in the current discussion of the proper use of P-values.

Feature Screening for Massive Data Analysis by Subsampling

A Sequential Addressing Subsampling Method for Massive Data Analysis under Memory Constraint

Subsampling and Jackknifing: A Practically Convenient Solution for Large Data Analysis with Limited Computational Resources

Deep Feature Screening: Feature Selection for Ultra High-Dimensional Data via Deep Neural Networks

On the Subbagging Estimation for Massive Data

Robust and efficient subsampling algorithms for massive data logistic regression

Estimation and testing of expectile regression with efficient subsampling for massive data

Sample size determination for multidimensional parameters and the A-optimal subsampling in a big data linear regression model

Estimating Extreme Value Index by Subsampling for Massive Datasets with Heavy-Tailed Distributions

Multi-resolution subsampling for large-scale linear classification

Feature Screening for Ultrahigh Dimensional Categorical Data with Applications

A screening method for ultra-high dimensional features with overlapped partition structures

Model-Free Feature Screening for Ultrahigh Dimensional Discriminant Analysis

Optimal Subsampling Approaches for Large Sample Linear Regression

Projection-Uniform Subsampling Methods for Big Data

Strong Sure Screening of Ultra-high Dimensional Categorical Data

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

Subsampling Winner Algorithm for Feature Selection in Large Regression Data

Feature screening for ultrahigh-dimensional binary classification via linear projection

Model-free Feature Screening for Ultrahigh Dimensional Data Via a Pearson Chi-Square Based Index

Model-free feature screening based on Hellinger distance for ultrahigh dimensional data