Abstract:The simultaneous estimation of multiple unknown parameters lies at heart of a broad class of important problems across science and technology. Currently, the state-of-the-art performance in the such problems is achieved by nonparametric empirical Bayes methods. However, these approaches still suffer from two major issues. First, they solve a frequentist problem but do so by following Bayesian reasoning, posing a philosophical dilemma that has contributed to somewhat uneasy attitudes toward empirical Bayes methodology. Second, their computation relies on certain density estimates that become extremely unreliable in some complex simultaneous estimation problems. In this paper, we study these issues in the context of the canonical Gaussian sequence problem. We propose an entirely frequentist alternative to nonparametric empirical Bayes methods by establishing a connection between simultaneous estimation and penalized nonparametric regression. We use flexible regularization strategies, such as shape constraints, to derive accurate estimators without appealing to Bayesian arguments. We prove that our estimators achieve asymptotically optimal regret and show that they are competitive with or can outperform nonparametric empirical Bayes methods in simulations and an analysis of spatially resolved gene expression data.

Efficient Estimation of Non Parametric Simultaneous Equations Models

Local Polynomial Estimation of Nonparametric Simultaneous Equations Models

A Nonparametric GMM Series Approach to Solving Multi-equation Asset Pricing Models with Recursive Preferences

Efficient Estimation for Error Component Seemingly Unrelated Nonparametric Regression Models

On Estimating the Nonparametric Multiplicative Error Models

Nonparametric Regression Estimation with General Parametric Error Covariance: a More Efficient Two-Step Estimator

More Efficient Estimation of Nonparametric Panel Data Models with Random Effects

Parameter Estimation for Multivariate Nonlinear Stochastic Differential Equation Models: A Comparison Study

Solving Euler equations via two-stage nonparametric penalized splines

Estimation in Semiparametric Models with Missing Data

Robust estimation in a nonlinear cointegration model

Semiparametric efficient estimation in high‐dimensional partial linear regression models

Econometric Modeling and Economic Forecasting

Local Linear Estimation with Instrumental Variables for Non-Parametric Simultaneous Equations Econometric Model

Improving Semiparametric Estimation by Using Surrogate Data

Nonparametric Estimation via Partial Derivatives

Semiparametric Inference for Estimating Equations with Nonignorably Missing Covariates

Estimation of non‐smooth non‐parametric estimating equations models with dependent data

MORE EFFICIENT ESTIMATION IN NONPARAMETRIC REGRESSION WITH NONPARAMETRIC AUTOCORRELATED ERRORS

A nonparametric regression alternative to empirical Bayes approaches to simultaneous estimation

Efficient Estimation in Varying Coefficient Panel Data Model with Different Smoothing Variables and Fixed Effects