Abstract:The rapid advancement of high-throughput sequencing technologies has revolutionised genomic research by providing access to large amounts of genomic data. However, the most important disadvantage of using Whole Genome Sequencing (WGS) data is its statistical nature, the so-called p>>n problem. This study aimed to compare three approaches of feature selection allowing for circumventing the p>>n problem, among which one is a novel modification of Supervised Rank Aggregation (SRA). The use of the three methods was demonstrated in the classification of 1,825 individuals representing the 1000 Bull Genomes Project to 5 breeds, based on 11,915,233 SNP genotypes from WGS. In the first step, we applied three feature (i.e. SNP) selection methods: the mechanistic approach (SNP tagging) and two approaches considering biological and statistical contexts by fitting a multiclass logistic regression model followed by either 1-dimensional clustering (1D-SRA) or multi-dimensional feature clustering (MD-SRA) that was originally proposed in this study. Next, we perform the classification based on a Deep Learning architecture composed of Convolutional Neural Networks. The classification quality of the test data set was expressed by macro F1-Score. The SNPs selected by SNP tagging yielded the least satisfactory results (86.87%). Still, this approach offered rapid computing times by focussing only on pairwise LD between SNPs and disregarding the effects of SNP on classification. 1D-SRA was less suitable for ultra-high-dimensional applications due to computational, memory and storage limitations, however, the SNP set selected by this approach provided the best classification quality (96.81%). MD-SRA provided a very good balance between classification quality (95.12%) and computational efficiency (17x lower analysis time and 14x lower data storage), outperforming other methods. Moreover, unlike SNP tagging, both SRA-based approaches are universal and not limited to feature selection for genomic data. Our work addresses the urgent need for computational techniques that are both effective and efficient in the analysis and interpretation of large-scale genomic datasets. We offer a model suitable for the classification of ultra-high-dimensional data that implements fusing feature selection and deep learning techniques.

Fast stepwise regression based on multidimensional indexes

Stepwise regression for unsupervised learning

High-dimensional regression in practice: an empirical study of finite-sample prediction, variable selection and ranking

Ultra high-dimensional semiparametric longitudinal data analysis

Sequential scaled sparse factor regression

Factor Profiling for Ultra High Dimensional Variable Selection

Stepwise Choice of Covariates in High Dimensional Regression

Functional Extreme-PLS

A Multilayered-and-Randomized Latent Factor Model for High-Dimensional and Sparse Matrices

Scalable Bayesian regression in high dimensions with multiple data sources

Modeling longitudinal data using matrix completion

Robustifying and simplifying high-dimensional regression with applications to yearly stock return and telematics data

A Two-Stage Variable Selection Approach for Correlated High Dimensional Predictors

A Constructive Approach to High-dimensional Regression

Repeated Sieving for Prediction Model Building with High-Dimensional Data

Bayesian Variable Selection in Linear Regression in One Pass for Large Data Sets

Robust Approach for Variable Selection with High Dimensional Longitudinal Data Analysis

A Sequential Regression Model for Big Data with Attributive Explanatory Variables

Approaches to dimensionality reduction for ultra-high dimensional models

Simultaneous Selection of Predictors and Responses for High Dimensional Multivariate Linear Regression

Selection of important variables and determination of functional form for continuous predictors in multivariable model building