Abstract:The weighted nearest neighbors (WNN) estimator has been popularly used as a flexible and easy-to-implement nonparametric tool for mean regression estimation. The bagging technique is an elegant way to form WNN estimators with weights automatically generated to the nearest neighbors (Steele, 2009; Biau et al., 2010); we name the resulting estimator as the distributional nearest neighbors (DNN) for easy reference. Yet, there is a lack of distributional results for such estimator, limiting its application to statistical inference. Moreover, when the mean regression function has higher-order smoothness, DNN does not achieve the optimal nonparametric convergence rate, mainly because of the bias issue. In this work, we provide an in-depth technical analysis of the DNN, based on which we suggest a bias reduction approach for the DNN estimator by linearly combining two DNN estimators with different subsampling scales, resulting in the novel two-scale DNN (TDNN) estimator. The two-scale DNN estimator has an equivalent representation of WNN with weights admitting explicit forms and some being negative. We prove that, thanks to the use of negative weights, the two-scale DNN estimator enjoys the optimal nonparametric rate of convergence in estimating the regression function under the fourth-order smoothness condition. We further go beyond estimation and establish that the DNN and two-scale DNN are both asymptotically normal as the subsampling scales and sample size diverge to infinity. For the practical implementation, we also provide variance estimators and a distribution estimator using the jackknife and bootstrap techniques for the two-scale DNN. These estimators can be exploited for constructing valid confidence intervals for nonparametric inference of the regression function. The theoretical results and appealing finite-sample performance of the suggested two-scale DNN method are illustrated with several simulation examples and a real data application.

Application of CWNN Based on Dynamic Clustering Algorithm in On-line Paper Density Measurement

Multiresolution analysis and estimation of the basis weight signal in papermaking processes

Integration of Density-Based Spatial Clustering with Noise and Continuous Wavelet Transform for Feature Extraction from Seismic Data

Cross‐directional Estimation and Predictive Control of Paper Machines Using DWT

Study on WN Applied in Ferment Process

Cross-directional Modeling and Control of Paper-Making Processes in the Discrete Wavelet Transform Domain

Weighted Nonlinear Dynamic System for Deep Extraction of Nonlinear Dynamic Latent Variables and Industrial Application

A New Density Estimation Neural Network to Detect Abnormal Condition in Streaming Data

Nonlinear Dynamic System Identification Based on Wavelet Approximation

Data Classification Based on Density Function Estimated by Radial Basis Function

Research on Data Processing of Dynamic Vehicle Weighbridge with Wavelet Neural Network

An Improved Knn Text Classification Algorithm Based On Density

Clustering by Deep Nearest Neighbor Descent (D-NND): A Density-based Parameter-Insensitive Clustering Method

Tool condition monitoring in CNC end milling using wavelet neural network based on machine vision

Application Of An Improved Clustering Algorithm To Batch Process Online Monitoring

Continuous wavelet process neural network and its application

Multi-level Clustering Based on Cluster Order Constructed with Dynamic Local Density

An Improved Density-Based Spatial Clustering of Application with Noise

Research on improved convolutional wavelet neural network

Optimal Nonparametric Inference with Two-Scale Distributional Nearest Neighbors

An Estimation of Distribution Algorithm Based Dynamic Clustering Approach for Wireless Sensor Networks