Abstract:High throughput biomedical measurements normally capture multiple overlaid biologically relevant signals and often also signals representing different types of technical artefacts like e.g. batch effects. Signal identification and decomposition are accordingly main objectives in statistical biomedical modeling and data analysis. Existing methods, aimed at signal reconstruction and deconvolution, in general, are either supervised, contain parameters that need to be estimated or present other types of ad hoc features. We here introduce SubMatrix Selection SingularValue Decomposition (SMSSVD), a parameter-free unsupervised signal decomposition and dimension reduction method, designed to reduce noise, adaptively for each low-rank-signal in a given data matrix, and represent the signals in the data in a way that enable unbiased exploratory analysis and reconstruction of multiple overlaid signals, including identifying groups of variables that drive different signals. The Submatrix Selection Singular Value Decomposition (SMSSVD) method produces a denoised signal decomposition from a given data matrix. The SMSSVD method guarantees orthogonality between signal components in a straightforward manner and it is designed to make automation possible. We illustrate SMSSVD by applying it to several real and synthetic datasets and compare its performance to golden standard methods like PCA (Principal Component Analysis) and SPC (Sparse Principal Components, using Lasso constraints). The SMSSVD is computationally efficient and despite being a parameter-free method, in general, outperforms existing statistical learning methods. A Julia implementation of SMSSVD is openly available on GitHub (<a class="link-external link-https" href="https://github.com/rasmushenningsson/SMSSVD.jl" rel="external noopener nofollow">this https URL</a>).

A cross-associative neural network for SVD of nonsquared data matrix in signal processing

A Cross-Associative Neural Network Used As Svd Of Non-Square Data Matrix Or Cross-Correlation Matrix In Signal Processing

A Neural Network Learning for Adaptively Extracting Cross-Correlation Features Between Two High-Dimensional Data Streams

Sparse Covariance Neural Networks

Cross-Correlation Neural Network Models For The Smallest Singular Component Of General Matrix

Learning in Feature Spaces via Coupled Covariances: Asymmetric Kernel SVD and Nyström method

Online singular value decomposition of time-varying matrix via zeroing neural dynamics.

Fast CNN Inference by Adaptive Sparse Matrix Decomposition.

SVCCA: Singular Vector Canonical Correlation Analysis for Deep Learning Dynamics and Interpretability

A Sparse SVD Method for High-dimensional Data

SVD-based algorithms for fully-connected tensor network decomposition

Very Large-Scale Singular Value Decomposition Using Tensor Train Networks

Efficient Asynchronous Semi-Stochastic Block Coordinate Descent Methods for Large-Scale SVD

SMSSVD - SubMatrix Selection Singular Value Decomposition

Effective SVD-Based Deep Network Compression for Automatic Speech Recognition.

A Novel SVD-SDP-CNN Fault Diagnosis Method

Nonlinear SVD with Asymmetric Kernels: feature learning and asymmetric Nyström method

Nonlinear SVD with Asymmetric Kernels: feature learning and asymmetric Nystr\"om method

Fast Updating Truncated SVD for Representation Learning with Sparse Matrices

Tensor Neural Network Models for Tensor Singular Value Decompositions.

A Single-Side Neural Network-Aided Canonical Correlation Analysis With Applications to Fault Diagnosis