Abstract:BackgroundBioinformatics data analysis is often using linear mixture model representing samples as additive mixture of components. Properly constrained blind matrix factorization methods extract those components using mixture samples only. However, automatic selection of extracted components to be retained for classification analysis remains an open issue.ResultsThe method proposed here is applied to well-studied protein and genomic datasets of ovarian, prostate and colon cancers to extract components for disease prediction. It achieves average sensitivities of: 96.2 (sd = 2.7%), 97.6% (sd = 2.8%) and 90.8% (sd = 5.5%) and average specificities of: 93.6% (sd = 4.1%), 99% (sd = 2.2%) and 79.4% (sd = 9.8%) in 100 independent two-fold cross-validations.ConclusionsWe propose an additive mixture model of a sample for feature extraction using, in principle, sparseness constrained factorization on a sample-by-sample basis. As opposed to that, existing methods factorize complete dataset simultaneously. The sample model is composed of a reference sample representing control and/or case (disease) groups and a test sample. Each sample is decomposed into two or more components that are selected automatically (without using label information) as control specific, case specific and not differentially expressed (neutral). The number of components is determined by cross-validation. Automatic assignment of features (m/z ratios or genes) to particular component is based on thresholds estimated from each sample directly. Due to the locality of decomposition, the strength of the expression of each feature across the samples can vary. Yet, they will still be allocated to the related disease and/or control specific component. Since label information is not used in the selection process, case and control specific components can be used for classification. That is not the case with standard factorization methods. Moreover, the component selected by proposed method as disease specific can be interpreted as a sub-mode and retained for further analysis to identify potential biomarkers. As opposed to standard matrix factorization methods this can be achieved on a sample (experiment)-by-sample basis. Postulating one or more components with indifferent features enables their removal from disease and control specific components on a sample-by-sample basis. This yields selected components with reduced complexity and generally, it increases prediction accuracy.

A Common Factor-Analytic Model for Classification.

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Discriminative Concept Factorization for Data Representation

High-dimensional Factor Model and Its Applications to Statistical Machine Learning

A sparse factor model for clustering high‐dimensional longitudinal data

Covariance-enhanced Discriminant Analysis.

Parsimonious Mixtures of Matrix Variate Bilinear Factor Analyzers

Integrating Approximate Single Factor Graphical Models.

Factor Adjusted Spectral Clustering for Mixture Models

A mixture model with a reference-based automatic selection of components for disease classification from protein and/or gene expression levels

COMBINING GENERALIZED NMF AND DISCRIMINATIVE MIXTURE MODELS FOR CLASSIFICATION OF GENE EXPRESSION DATA

A High-Dimensional Classification Approach Based on Class-Dependent Feature Subspace.

Discriminant Analysis Methods for Microarray Data Classification

Optimal Discriminant Analysis in High-Dimensional Latent Factor Models

A factor mixture analysis model for multivariate binary data

An Efficient and Principled Model to Jointly Learn the Agnostic and Multifactorial Effect in Large-Scale Biological Data

High-Dimensional Covariate-Augmented Overdispersed Multi-Study Poisson Factor Model

Infinite max-margin factor analysis via data augmentation

Supervised clustering of high-dimensional data using regularized mixture modeling

A Combining Dimensionality Reduction Approach for Cancer Classification.

Dimension reduction with redundant gene elimination for tumor classification