The M-estimate of the Local Linear Regression with Variable Bandwiths

JIANG Xue-jun,XIA Tian,TANG Nian-sheng

DOI: https://doi.org/10.3321/j.issn:0258-7971.2006.01.003

2006-01-01

Abstract:By constructing the conditions consistent with its solution,and employing the theorem of the immobile point in functional analysis,it is proved that the existence and uniqueness of the local M-estimate with some conditions.

What problem does this paper attempt to address?

Local Linear M‐estimation in Non‐parametric Spatial Regression

Zhengyan Lin,Degui Li,Jiti Gao

DOI: https://doi.org/10.1111/j.1467-9892.2009.00612.x

2009-01-01

Journal of Time Series Analysis

Abstract:A robust version of local linear regression smoothers augmented with variable bandwidths is investigated for dependent spatial processes. The (uniform) weak consistency as well as asymptotic normality for the local linear M-estimator (LLME) of the spatial regression function g(x) are established under some mild conditions. Furthermore, an additive model is considered to avoid the curse of dimensionality for spatial processes and an estimation procedure based on combining the marginal integration technique with LLME is applied in this paper. Meanwhile, we present a simulated study to illustrate the proposed estimation method. Our simulation results show that the estimation method works well numerically.
Local Linear Multiple Regression with Variable Bandwidth in the Presence of Heteroscedasticity

YE A-zhong,Chong‐En Bai,Yongmiao Hong,Rob Hyndman,LI Zi-nai,David Li

2006-01-01

Abstract:We present local linear estimator with variable bandwidth for multivariate nonpara- metric regression. We prove its consistency and asymptotic normality in interior and obtain its rates of convergence. For heteroscedastic models, the local linear estimator with variable bandwidth has better goodness of flt than the local linear estimator with constant bandwidth.
Spatial local M-estimation under association

Chen Jia,Zhang Lixin,Li Degui

DOI: https://doi.org/10.1007/s00184-006-0119-y

IF: 0.96

2007-01-01

Metrika

Abstract:We investigate the asymptotic behavior of a robust version of local linear regression estimators with variable bandwidth for spatial associated processes. The weak consistency of the proposed estimators is given under appropriate conditions. Furthermore, we establish the asymptotic normality of the estimators, from which expressions for the asymptotic bias and variance can be derived.
Local Linear M-Estimators in Null Recurrent Time Series

Zhengyan Lin,Degui Li,Jia Chen

IF: 1.4

2009-01-01

Statistica Sinica

Abstract:In this paper, we study a nonlinear cointegration type model Y-k = m(X-k) + w(k), where {Y-k} and {X-k} are observed nonstationary processes and {w(k)} is an unobserved stationary process. The process {X-k} is assumed to be a null-recurrent Markov chain. We apply a robust version of local linear regression smoothers to estimate m(.). Under mild conditions, the uniform weak consistency and asymptotic normality of the local linear M-estimators are established. Furthermore, a one-step iterated procedure is introduced to obtain the local linear M-estimator and the optimal bandwidth selection is discussed. Meanwhile, some numerical examples are given to show that the proposed theory and methods perform well in practice.
Local linear estimator for stochastic differential equations driven by $\alpha$-stable L\'{e}vy motions

song yuping,lin zhengyan

2012-01-01

Abstract: We study the local linear estimator for the drift coefficient of stochastic differential equations driven by $\alpha$-stable L\'{e}vy motions observed at discrete instants letting $T \rightarrow \infty$. Under regular conditions, we derive the weak consistency and central limit theorem of the estimator. Compare with Nadaraya-Watson estimator, the local linear estimator has a bias reduction whether kernel function is symmetric or not under different schemes.
A Semi-parametric Estimation for Local Linear Regression

WU Ting,LIU San-yang,ZHOU Jie

DOI: https://doi.org/10.3969/j.issn.1005-3085.2013.05.007

2013-01-01

Abstract:To improve the convergence rate and the robustness of bandwidth selection of the local linear estimation, an improved semi-parametric estimation is proposed in this paper. At first, several local linear estimators with different bandwidths are carried out, and then combined by a parametric regression technique to construct an improved one. Compared with the ordinary local linear estimator, the asymptotic bias of the new estimator can be reduced from an order of h2 to h4 without changing the order of asymptotic variance. Consequently, the optimal convergence rate of such estimator can attain O(n?89 ) which is also robust to the selection of bandwidth. Numerical simulations show that the new approach outperform the local linear estimator.
M-Band Scaling Function with Filter Having Vanishing Moments Two and Minimal Length

Qiyu Sun,Zeyin Zhang

DOI: https://doi.org/10.1006/jmaa.1998.5936

IF: 1.417

1998-01-01

Journal of Mathematical Analysis and Applications

Abstract:In this paper we consider the Hölder continuity, local linearity, linear independence, and interpolation problem of theM-band scaling function, with a filter having vanishing moments two and minimal length. In particular, we find some new properties that are not true whenM=2, such as local linearity, local linear dependence, differentiability at adjointM-adic points, and interpolation problem at integer knots.
Local linear M-estimation for spatial processes in fixed-design models

Jia Chen,Li-Xin Zhang

DOI: https://doi.org/10.1007/s00184-009-0233-8

IF: 0.96

2009-01-01

Metrika

Abstract:We investigate the local linear M-estimation for regression in a fixed-design model when the errors are from a strongly mixing random field. We establish the weak and strong consistency as well as the asymptotic normality of the local linear M-estimator. The conditions on ρ (·) used in this paper are mild and allow many important special cases such as the least square estimator and the least absolute distance estimator.
Local linear multivariate regression with variable bandwidth in the presence of heteroscedasticity

azhong ye,rob j hyndman,zinai li

DOI: https://doi.org/10.4225/03/59378e30aafac

2006-01-01

Abstract:We present a local linear estimator with variable bandwidth for multivariate non-parametric regression. We prove its consistency and asymptotic normality in the interior of the observed data and obtain its rates of convergence. This result is used to obtain practical direct plug-in bandwidth selectors for heteroscedastic regression in one and two dimensions. We show that the local linear estimator with variable bandwidth has better goodness-of-fit properties than the local linear estimator with constant bandwidth, in the presence of heteroscedasticity.
Kernel Estimation with Variable Bandwidth for Nonparametric Regression Econometric Models

YE A-zhong

DOI: https://doi.org/10.3969/j.issn.1000-2243.2006.02.007

2006-01-01

Abstract:This paper presents local linear estimators with variable bandwidth for nonparametric regression econometric models in the random design case that all variables in models are stochastic.We prove its consistency and asymptotic normality in interior by using laws of large numbers and central limit theorems in probability.Its rates of convergence in interior points equal the optimal rate convergence for estimating nonparametric function.
Theory of Variable Bandwidth Estimation for Semi-Parametric Simultaneous Equations Econometric Models

YE A-zhong,WU Xiang-bo,HUANG Zhi-gang

DOI: https://doi.org/10.3969/j.issn.1000-2243.2007.06.008

2009-01-01

Abstract:Econometric simultaneous equation models play an important role in making economic policies,analyzing economic structure and economic forecasting.This paper presents an estimation method for semi-parametric simultaneous equations econometric model.A local linear estimation with variable bandwidth was used with instrumental variables,when all variables were random.A local linear estimation method for semi-parametric single equation model was combined with the traditional instrumental variable method for simultaneous equations model.The properties under large sample size were studied by using the asymptotic theory.The results show that the estimators of the parameters have consistency and asymptotic normality,and their convergence rates are equal to n-1/2.Further the estimator of the nonparametric function has the consistency and asymptotic normality in interior points and its rate of convergence is equal to the optimal convergence rate of the nonparametric function estimation.
Multivariate bandwidth selection for local linear regression

L. Yang,R. Tschernig

DOI: https://doi.org/10.1111/1467-9868.00203

1999-01-01

Abstract:The existence and properties of optimal bandwidths for multivariate local linear regression are established, using either a scalar bandwidth for all regressors or a diagonal bandwidth vector that has a different bandwidth for each regressor. Both involve functionals of the derivatives of the unknown multivariate regression function. Estimating these functionals is difficult primarily because they contain multivariate derivatives. In this paper, an estimator of the multivariate second derivative is obtained via local cubic regression with most cross-terms left out. This estimator has the optimal rate of convergence but is simpler and uses much less computing time than the full local estimator. Using this as a pilot estimator, we obtain plug-in formulae for the optimal bandwidth, both scalar and diagonal, for multivariate local linear regression. As a simpler alternative, we also provide rule-of-thumb bandwidth selectors. All these bandwidths have satisfactory performance in our simulation study.
Robust estimation in a nonlinear cointegration model

Jia Chen,Degui Li,Lixin Zhang

DOI: https://doi.org/10.1016/j.jmva.2009.09.004

IF: 1.387

2010-01-01

Journal of Multivariate Analysis

Abstract:This paper considers the nonparametric M-estimator in a nonlinear cointegration type model. The local time density argument, which was developed by Phillips and Park (1998) [6] and Wang and Phillips (2009) [9], is applied to establish the asymptotic theory for the nonparametric M-estimator. The weak consistency and the asymptotic distribution of the proposed estimator are established under mild conditions. Meanwhile, the asymptotic distribution of the local least squares estimator and the local least absolute distance estimator can be obtained as applications of our main results. Furthermore, an iterated procedure for obtaining the nonparametric M-estimator and a cross-validation bandwidth selection method are discussed, and some numerical examples are provided to show that the proposed methods perform well in the finite sample case.
One-step Local M-estimates of Partial Linear Models with Missing Date

Yan Liu,Xiangdong Song,Haitao Liu,Lihua Wang

DOI: https://doi.org/10.1109/icmt.2011.6002557

2011-01-01

Abstract:In the case of response data missing, the variable bandwidth and one-step local M-estimates are employed to estimate the unknown function and the unknown parameter in the partial linear models. The estimators of nonparametric componets are given by one-step local M-estimation, and the estimators of parametric components are obtained by one-step local M-estimation and average method. Moreover, the variable bandwidth is inserted to improve the one-step local M-estimation At last, the asymptotical normality of these estimators is established.
Multivariate Plug-in Bandwidth for Local Linear Regression

Lijian Yang,Rolf Tschernig

DOI: https://doi.org/10.18452/3855

1998-01-01

Abstract:Optimal bandwidths for local polynomial regression usually involve functionals of the derivatives of the unknown regression function. In the multivariate case, estimates of these functionals are not readily available, primarily because estimating multivariate derivatives is complicated. In this paper, an estimator of multivariate second derivative is obtained via local quadratic regression with cross terms left out. This estimator has the optimal rate of convergence but is simpler and uses a lot less computing time than the full local quadratic estimator. Using this as a pilot estimator, an estimator of the integrated squared Laplacian of a multivariate regression function is obtained which leads to a plug-in formula of the optimal bandwidth for multivariate local linear regression. This bandwidth has good theoretical properties as well as satisfactory performance in our simulation study. It is also recommended for variable selection methods.
Local Linear Estimation for Regression Models with Locally Stationary Long Memory Errors

Wang Lihong

DOI: https://doi.org/10.1016/j.jkss.2015.12.005

2016-01-01

Abstract:In this paper we consider the local linear regression estimation for the nonparametric regression models with locally stationary long memory errors. The asymptotic behaviors of the regression estimators are established. It is shown that there is a multiple bandwidth dichotomy for the asymptotic distribution of the estimators of the regression function and its derivatives. The finite sample performance of the estimator is discussed through simulation studies.
Local Linear Estimation by TSLS with Variable Bandwidth for Nonparametric Simultaneous Equation Models in Econometrics

叶阿忠

DOI: https://doi.org/10.3969/j.issn.1007-3221.2002.01.011

2004-01-01

Abstract:Simultaneous equation models play an important role in making economic policies, analyzing economic structure and economic forecasting. This paper presents local linear estimators by TSLS with Variable Bandwidth for every structural equation in nonparametric simultaneous equation models in the random design case that all variables in model are stochastic. We prove its consistency and asymptotic normality in interior by using laws of large numbers and central limit theorems in probability. Its rates of convergence in interior points equal the optimal rate convergence for estimating nonparametric function.
Theory of variable bandwidth estimation for non-parametric simultaneous equation econometric models

YE A-zhong

DOI: https://doi.org/10.3321/j.issn:1007-9807.2009.02.007

2004-01-01

Abstract:Econometric simultaneous equation models play an important role in making economic policies,analyzing economic structure and economic forecasting.This paper presents an estimation method for semi-parametric simultaneous equations econometric model.A local linear estimation with variable bandwidth was used with instrumental variables,when all variables were random.A local linear estimation method for semi-parametric single equation model was combined with the traditional instrumental variable method for simultaneous equations model.The properties under large sample size were studied by using the asymptotic theory.The results show that the estimators of the parameters have consistency and asymptotic normality,and their convergence rates are equal to n-1/2.Further the estimator of the nonparametric function has the consistency and asymptotic normality in interior points and its rate of convergence is equal to the optimal convergence rate of the nonparametric function estimation.
Bahadur Representation of Nonparametric M-Estimators for Spatial Processes

Jia Chen,De Gui Li,Li Xin Zhang

DOI: https://doi.org/10.1007/s10114-008-6589-2

2008-01-01

Abstract:Under some mild conditions, we establish a strong Bahadur representation of a general class of nonparametric local linear M -estimators for mixing processes on a random field. If the so-called optimal bandwidth h n = O (| n | −1/5 ), n ∈ Z d , is chosen, then the remainder rates in the Bahadur representation for the local M -estimators of the regression function and its derivative are of order O (| n | −4/5 log | n |). Moreover, we derive some asymptotic properties for the nonparametric local linear M -estimators as applications of our result.
Some Theoretical Results Concerning Time-varying Nonparametric Regression with Local Stationary Regressors and Error

Jiyanglin Li,Tao Li

DOI: https://doi.org/10.48550/arxiv.2010.12895

2020-01-01

Abstract: With regard to a three-step estimation procedure, proposed without theoretical discussion by Li and You in Journal of Applied Statistics and Management, for a nonparametric regression model with time-varying regression function, local stationary regressors and time-varying AR(p) (tvAR(p)) error process , we established all necessary asymptotic properties for each of estimator. We derive the convergence rate and asymptotic normality of the preliminary estimation of nonparametric regression function, establish the asymptotic distribution of time-varying coefficient functions in the error term, and present the asymptotic property of the refined estimation of nonparametric regression function. In addition, with regard to the ULASSO method for variable selection and constant coefficient detection for error term structure, we show that the ULASSO estimator can identify the true error term structure consistently. We conduct two simulation studies to illustrate the finite sample performance of the estimators and validate our theoretical discussion on the properties of the estimators.

The M-estimate of the Local Linear Regression with Variable Bandwiths

Local Linear M‐estimation in Non‐parametric Spatial Regression

Local Linear Multiple Regression with Variable Bandwidth in the Presence of Heteroscedasticity

Spatial local M-estimation under association

Local Linear M-Estimators in Null Recurrent Time Series

Local linear estimator for stochastic differential equations driven by $\alpha$-stable L\'{e}vy motions

A Semi-parametric Estimation for Local Linear Regression

M-Band Scaling Function with Filter Having Vanishing Moments Two and Minimal Length

Local linear M-estimation for spatial processes in fixed-design models

Local linear multivariate regression with variable bandwidth in the presence of heteroscedasticity

Kernel Estimation with Variable Bandwidth for Nonparametric Regression Econometric Models

Theory of Variable Bandwidth Estimation for Semi-Parametric Simultaneous Equations Econometric Models

Multivariate bandwidth selection for local linear regression

Robust estimation in a nonlinear cointegration model

One-step Local M-estimates of Partial Linear Models with Missing Date

Multivariate Plug-in Bandwidth for Local Linear Regression

Local Linear Estimation for Regression Models with Locally Stationary Long Memory Errors

Local Linear Estimation by TSLS with Variable Bandwidth for Nonparametric Simultaneous Equation Models in Econometrics

Theory of variable bandwidth estimation for non-parametric simultaneous equation econometric models

Bahadur Representation of Nonparametric M-Estimators for Spatial Processes

Some Theoretical Results Concerning Time-varying Nonparametric Regression with Local Stationary Regressors and Error