Uncertainty Quantification for nonparametric regression using Empirical Bayesian neural networks

Stefan Franssen,Botond Szabó
DOI: https://doi.org/10.48550/arXiv.2204.12735
2022-04-28
Abstract:We propose a new, two-step empirical Bayes-type of approach for neural networks. We show in context of the nonparametric regression model that the procedure (up to a logarithmic factor) provides optimal recovery of the underlying functional parameter of interest and provides Bayesian credible sets with frequentist coverage guarantees. The approach requires fitting the neural network only once, hence it is substantially faster than Bootstrapping type approaches. We demonstrate the applicability of our method over synthetic data, observing good estimation properties and reliable uncertainty quantification.
Statistics Theory
What problem does this paper attempt to address?