Abstract:Random forests have emerged as a promising tool in comparative metagenomics because they can predict environmental characteristics based on microbial composition in datasets where β -diversity metrics fall short of revealing meaningful relationships between samples. Nevertheless, despite this efficacy, they lack biological insight in tandem with their predictions, potentially hindering scientific advancement. To overcome this limitation, we leverage a geometric characterization of random forests to introduce a data-driven phylogenetic β -diversity metric, the adaptive Haar-like distance. This new metric assigns a weight to each internal node (i.e., split or bifurcation) of a reference phylogeny, indicating the relative importance of that node in discerning environmental samples based on their microbial composition. Alongside this, a weighted nearest-neighbors classifier, constructed using the adaptive metric, can be used as a proxy for the random forest while maintaining accuracy on par with that of the original forest and another state-of-the-art classifier, CoDaCoRe. As shown in datasets from diverse microbial environments, however, the new metric and classifier significantly enhance the biological interpretability and visualization of high-dimensional metagenomic samples. Traditional phylogenetic β -diversity metrics, particularly weighted and unweighted UniFrac, have had great success in comparing and visualizing high-dimensional metagenomic samples. Nonetheless, these metrics rely upon pre-established biological assumptions that might not capture key microbial players or relationships between some samples. On the contrary, supervised machine learning algorithms, such as random forests, can often capture intricate relationships between microbial samples; however, unveiling these relationships is often challenging due to the intricate inner mechanisms inherent to these algorithms. The adaptive Haar-like distance integrates the merits of β -diversity metrics and random forests, allowing for precise, intuitive, and visual comparison of metagenomic samples, offering valuable scientific insight into the distinctions and associations among microbial environments.

Unsupervised Random Forest for Affinity Estimation

X Forest: Approximate Random Projection Trees for Similarity Measurement

Random Similarity Forests

Anatomical Structure Similarity Estimation By Random Forest

Random Forests for Adaptive Nearest Neighbor Estimation of Information-Theoretic Quantities

UniForCE: The Unimodality Forest Method for Clustering and Estimation of the Number of Clusters

Unsupervised Learning With Random Forest Predictors

Unsupervised Random Forest Manifold Alignment for Lipreading

Random Forest Weighted Local Fréchet Regression with Random Objects

Affinity Derivation for Accurate Instance Segmentation.

A New Rotation Forest Ensemble Algorithm

Minimax Rates for High-Dimensional Random Tessellation Forests

Fréchet random forests for metric space valued regression with non euclidean predictors

Cluster Forests

Random Forest-Supervised Manifold Alignment

Interpretable metric learning in comparative metagenomics: The adaptive Haar-like distance

Unsupervised Co-Segmentation of 3D Shapes Via Affinity Aggregation Spectral Clustering.

Semi-Supervised Nonlinear Distance Metric Learning via Forests of Max-Margin Cluster Hierarchies

Unsupervised Feature Selection Via Metric Fusion and Novel Low-Rank Approximation

Self-Supervised Random Forest on Transformed Distribution for Anomaly Detection

Deep Affinity Net: Instance Segmentation via Affinity