Abstract:The advent of high-throughput sequencing technologies has revolutionized the field of multi-omics patient data analysis. While these techniques offer a wealth of information, they often generate datasets with dimensions far surpassing the number of available cases. This discrepancy in size gives rise to the challenging “small-sample-size” problem, significantly compromising the reliability of any subsequent estimate, whether supervised or unsupervised. This calls for effective dimensionality reduction techniques to transform high-dimensional datasets into lower-dimensional spaces, making the data manageable and facilitating subsequent analyses. Unfortunately, the definition of a proper di-mensionality reduction pipeline is not an easy task; besides the problem of identifying the best dimensionality reduction method, the definition of the dimension of the lower-dimensional space into which each dataset should be transformed is a crucial issue that influences all the subsequent analyses and should therefore be carefully considered. Further, the availability of multi-modal data calls for proper data-fusion techniques to produce an integrated patient-view into which redundant information is removed while salient and complementary information across views is leveraged to improve the performance and reliability of both unsupervised and supervised learning techniques. This paper proposes leveraging the intrinsic dimensionality of each view in a multi-modal dataset to define the dimensionality of the lower-dimensional space where the view is transformed by dimensionality reduction algorithms. Further, it presents a thorough experimental study that compares the traditional application of a unique-step of dimensionality reduction with a two-step approach, involving a prior feature selection followed by feature extraction. Through this comparative evaluation, we scrutinize the performance of widely used dimensionality reduction algorithms. Importantly, we also investigate their impact on unsupervised data-fusion techniques, which are pivotal in biomedical research. Our findings shed light on the most effective strategies for handling high-dimensional multi-omics patient data, offering valuable insights for future studies in this domain.

Statistical Inference from High Dimensional Data

High dimensional statistical inference: theoretical development to data analytics

Model-Free Statistical Inference on High-Dimensional Data

Statistical Challenges with High Dimensionality: Feature Selection in Knowledge Discovery

High dimensionality: The latest challenge to data analysis

Towards Breaking the Curse of Dimensionality for High-Dimensional Privacy: An Extended Version

High--Dimensional Brain in a High-Dimensional World: Blessing of Dimensionality

Finding High-Order Correlations In High-Dimensional Biological Data

Interpreting the Curse of Dimensionality from Distance Concentration and Manifold Effect

Supervised dimensionality reduction for big data

Is Seeing Believing? A Practitioner's Perspective on High-Dimensional Statistical Inference in Cancer Genomics Studies

Recent Advances in Statistical Methodologies in Evaluating Program for High-Dimensional Data

Causal-StoNet: Causal Inference for High-Dimensional Complex Data

The key data mining models for high dimensional data

Statistical Inference on Explained Variation in High-dimensional Linear Model with Dense Effects

Hints from Information Theory for Analyzing Dynamic and High-Dimensional Biological Data

Enhancing Dimension-Reduced Scatter Plots with Class and Feature Centroids

Selecting Features by their Resilience to the Curse of Dimensionality

Sample size and statistical power considerations in high-dimensionality data settings: a comparative study of classification algorithms

Digital medicine and the curse of dimensionality

Intrinsic-Dimension analysis for guiding dimensionality reduction and data-fusion in multi-omics data processing