Abstract:Sufficient dimension reduction (SDR) primarily aims to reduce the dimensionality of high-dimensional predictor variables while retaining essential information about the responses. Traditional SDR methods typically employ kernel weighting functions, which unfortunately makes them susceptible to the curse of dimensionality. To address this issue, we in this paper propose novel forest-based approaches for SDR that utilize a locally adaptive kernel generated by Mondrian forests. Overall, our work takes the perspective of Mondrian forest as an adaptive weighted kernel technique for SDR problems. In the central mean subspace model, by integrating the methods from Xia et al. (J R Stat Soc Ser B (Stat Methodol) 64(3):363–410, 2002. https://doi.org/10.1111/1467-9868.03411) with Mondrian forest weights, we suggest the forest-based outer product of gradients estimation (mf-OPG) and the forest-based minimum average variance estimation (mf-MAVE). Moreover, we substitute the kernels used in nonparametric density function estimations (Xia in Ann Stat 35(6):2654–2690, 2007. https://doi.org/10.1214/009053607000000352), targeting the central subspace, with Mondrian forest weights. These techniques are referred to as mf-dOPG and mf-dMAVE, respectively. Under regularity conditions, we establish the asymptotic properties of our forest-based estimators, as well as the convergence of the affiliated algorithms. Through simulation studies and analysis of fully observable data, we demonstrate substantial improvements in computational efficiency and predictive accuracy of our proposals compared with the traditional counterparts.

DForest: A Minimal Dimensionality-Aware Indexing for High-Dimensional Exact Similarity Search

Accelerating Exact Nearest Neighbor Search in High Dimensional Euclidean Space Via Block Vectors

DESIRE: An Efficient Dynamic Cluster-based Forest Indexing for Similarity Search in Multi-Metric Spaces

Novel High-Dimensional Indexing Structure Based on Dual-Distance Metric

Indexing High-Dimensional Data in Dual Distance Spaces

Indexing high-dimensional data in dual distance spaces: a symmetrical encoding approach

Indexing very high-dimensional sparse and quasi-sparse vectors for similarity searches

Composite Distance Transformation for Indexing and K -Nearest-neighbor Searching in High-Dimensional Spaces

DIDS: Double Indices and Double Summarizations for Fast Similarity Search

Indexing high-dimensional data for efficient in-memory similarity search

Lazylsh: Approximate Nearest Neighbor Search For Multiple Distance Functions With A Single Index

Searching Dimension Incomplete Databases

New forest-based approaches for sufficient dimension reduction

Efficient Data-aware Distance Comparison Operations for High-Dimensional Approximate Nearest Neighbor Search

Local Feature Discriminant Projection

Soft Subspace Fuzzy Clustering with Dimension Affinity Constraint

FLEX: A Fast and Light-weight Learned Index for kNN Search in High-Dimensional Space

iDistance: An adaptive B+-tree based indexing method for nearest neighbor search

A Novel Spatial–Spectral Similarity Measure for Dimensionality Reduction and Classification of Hyperspectral Imagery

DIMS: Distributed Index for Similarity Search in Metric Spaces

X Forest: Approximate Random Projection Trees for Similarity Measurement