Abstract:The joint analysis of two datasets [Formula: see text] and [Formula: see text] that describe the same phenomena (e.g. the cellular state), but measure disjoint sets of variables (e.g. mRNA vs. protein levels) is currently challenging. Traditional methods typically analyze single interaction patterns such as variance or covariance. However, problem-tailored external knowledge may contain multiple different information about the interaction between the measured variables. We introduce MIASA, a holistic framework for the joint analysis of multiple different variables. It consists of assembling multiple different information such as similarity vs. association, expressed in terms of interaction-scores or distances, for subsequent clustering/classification. In addition, our framework includes a novel qualitative Euclidean embedding method (qEE-Transition) which enables using Euclidean-distance/vector-based clustering/classification methods on datasets that have a non-Euclidean-based interaction structure. As an alternative to conventional optimization-based multidimensional scaling methods which are prone to uncertainties, our qEE-Transition generates a new vector representation for each element of the dataset union [Formula: see text] in a common Euclidean space while strictly preserving the original ordering of the assembled interaction-distances. To demonstrate our work, we applied the framework to three types of simulated datasets: samples from families of distributions, samples from correlated random variables, and time-courses of statistical moments for three different types of stochastic two-gene interaction models. We then compared different clustering methods with vs. without the qEE-Transition. For all examples, we found that the qEE-Transition followed by Ward clustering had superior performance compared to non-agglomerative clustering methods but had a varied performance against ultrametric-based agglomerative methods. We also tested the qEE-Transition followed by supervised and unsupervised machine learning methods and found promising results, however, more work is needed for optimal parametrization of these methods. As a future perspective, our framework points to the importance of more developments and validation of distance-distribution models aiming to capture multiple-complex interactions between different variables.

Data-Driven Version of Multiway Soft Independent Modeling of Class Analogy (N-Way DD-SIMCA): Theory and Application

Multi-View Analysis Dictionary Learning for Image Classification.

Multivariate curve resolution-soft independent modelling of class analogy (MCR-SIMCA)

Simultaneous Dimensionality Reduction: A Data Efficient Approach for Multimodal Representations Learning

Discriminating sample groups with multi-way data

Sparse Linear Discriminant Analysis for Multi-view Structured Data

Multiway sparse distance weighted discrimination

Asymptotic behavior of some multicategory classification methods for high-dimensional data

Novelty and Similarity: Detection Using Data‐Driven Soft Independent Modeling of Class Analogy

Simultaneous and Orthogonal Decomposition of Data Using Multimodal Discriminant Analysis

Similarity-Based Multimodal Regression

Consistency and Complementarity Jointly Regularized Subspace Support Vector Data Description for Multimodal Data

Multi-Way, Multi-View Learning

Multi-Input data ASsembly for joint Analysis (MIASA): A framework for the joint analysis of disjoint sets of variables

Many Could Be Better Than All: A Novel Instance-Oriented Algorithm for Multi-modal Multi-label Problem.

DCSVM: fast multi-class classification using support vector machines

Distributed Sparse Multicategory Discriminant Analysis

Analysis of multi-way (multi-mode) data

Three-way Multi-Attribute Decision Making under Incomplete Mixed Environments Using Probabilistic Similarity.

Soft Independent Modeling of Class Analogy (SIMCA) Modeling of Laser-Induced Plasma Emission Spectra of Edible Salts for Accurate Classification

A multi-class SVM based on FCOWA-ER