Abstract:We consider high-dimensional multivariate linear regression models, where the joint distribution of covariates and response variables is a multivariate normal distribution with a bandable covariance matrix. The main goal of this paper is to estimate the regression coefficient matrix, which is a function of the bandable covariance matrix. Although the tapering estimator of covariance has the minimax optimal convergence rate for the class of bandable covariances, we show that it has a sub-optimal convergence rate for the regression coefficient; that is, a minimax estimator for the class of bandable covariances may not be a minimax estimator for its functionals. We propose the blockwise tapering estimator of the regression coefficient, which has the minimax optimal convergence rate for the regression coefficient under the bandable covariance assumption. We also propose a Bayesian procedure called the blockwise tapering post-processed posterior of the regression coefficient and show that the proposed Bayesian procedure has the minimax optimal convergence rate for the regression coefficient under the bandable covariance assumption. We show that the proposed methods outperform the existing methods via numerical studies.

Kernel Estimation with Variable Bandwidth for Nonparametric Regression Econometric Models

Local Linear Multiple Regression with Variable Bandwidth in the Presence of Heteroscedasticity

Local linear multivariate regression with variable bandwidth in the presence of heteroscedasticity

Local Linear M‐estimation in Non‐parametric Spatial Regression

Variable bandwidth kernel regression estimation

Local Linear M-Estimators in Null Recurrent Time Series

Asymptotic Behavior for S-estimators in Random Design Linear Model with Long-Range-dependent Errors

Kernel Averaging Estimators

Multivariate Plug-in Bandwidth for Local Linear Regression

Spatial local M-estimation under association

Multivariate bandwidth selection for local linear regression

Efficient Bandwidth Selection for Kernel Density Estimation

Multivariate Universal Local Linear Kernel Estimators in Nonparametric Regression: Uniform Consistency

Local Linear Estimation with Instrumental Variables for Non-Parametric Simultaneous Equations Econometric Model

Bandwidth Selection for Kernel Density Estimation with a Markov Chain Monte Carlo Sample

A Nonparametric Circular-Linear Multivariate Regression Model with a Rule-of-thumb Bandwidth Selector

Bayesian bandwidth estimation for a nonparametric functional regression model with mixed types of regressors and unknown error density

Asymptotically constant risk estimator of the time-average variance constant

Efficient Estimation for Semivarying-Coefficient Models

Estimation of Conditional Mean Operator under the Bandable Covariance Structure

Kernel Regression in Signal Estimation