Abstract:Statistical analysis is increasingly confronted with complex data from metric spaces. Petersen and Müller (2019) established a general paradigm of Fréchet regression with complex metric space valued responses and Euclidean predictors. However, the local approach therein involves nonparametric kernel smoothing and suffers from the curse of dimensionality. To address this issue, we in this paper propose a novel random forest weighted local Fréchet regression paradigm. The main mechanism of our approach relies on a locally adaptive kernel generated by random forests. Our first method uses these weights as the local average to solve the conditional Fréchet mean, while the second method performs local linear Fréchet regression, both significantly improving existing Fréchet regression methods. Based on the theory of infinite order U-processes and infinite order $M_{m_n}$-estimator, we establish the consistency, rate of convergence, and asymptotic normality for our local constant estimator, which covers the current large sample theory of random forests with Euclidean responses as a special case. Numerical studies show the superiority of our methods with several commonly encountered types of responses such as distribution functions, symmetric positive-definite matrices, and sphere data. The practical merits of our proposals are also demonstrated through the application to New York taxi data and human mortality data.

Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting

Local Linear M‐estimation in Non‐parametric Spatial Regression

Local Gaussian Regression

Optimal Weighting Distance-Based Similarity for Locally Weighted PLS Modeling

Data-Driven Predictive Model Based on Locally Weighted Bayesian Gaussian Regression

Mapping Local Regression for Spatial Object-Pairs

Local linear smoothing for regression surfaces on the simplex using Dirichlet kernels

Local Adaptive Grouped Regularization and its Oracle Properties for Varying Coefficient Regression

Local Linear Forests

Random Forest Weighted Local Fréchet Regression with Random Objects

Local linear M-estimation for spatial processes in fixed-design models

Local Linear Estimation for Regression Models with Locally Stationary Long Memory Errors

Response Surface Modeling by Local Kernel Partial Least Squares.

Subdivision Schemes Based on Weighted Local Polynomial Regression: A New Technique for the Convergence Analysis

Local polynomial regression for pooled response data

Locally Sparse Function on function Regression

Locality-Preserving Partial Least Squares Regression

A Locally Adaptive Interpretable Regression

Empirical Likelihood Confidence Intervals for Local Linear Smoothers

Localizing Changes in High-Dimensional Regression Models

Locally Adaptive Nonparametric Binary Regression