Abstract:We propose a general purpose confidence interval procedure (CIP) for statistical functionals constructed using data from a stationary time series. The procedures we propose are based on derived distribution-free analogues of the $\chi^2$ and Student's $t$ random variables for the statistical functional context, and hence apply in a wide variety of settings including quantile estimation, gradient estimation, M-estimation, CVAR-estimation, and arrival process rate estimation, apart from more traditional statistical settings. Like the method of subsampling, we use overlapping batches of time series data to estimate the underlying variance parameter; unlike subsampling and the bootstrap, however, we assume that the implied point estimator of the statistical functional obeys a central limit theorem (CLT) to help identify the weak asymptotics (called OB-x limits, x=I,II,III) of batched Studentized statistics. The OB-x limits, certain functionals of the Wiener process parameterized by the size of the batches and the extent of their overlap, form the essential machinery for characterizing dependence, and consequently the correctness of the proposed CIPs. The message from extensive numerical experimentation is that in settings where a functional CLT on the point estimator is in effect, using \emph{large overlapping batches} alongside OB-x critical values yields confidence intervals that are often of significantly higher quality than those obtained from more generic methods like subsampling or the bootstrap. We illustrate using examples from CVaR estimation, ARMA parameter estimation, and NHPP rate estimation; R and MATLAB code for OB-x critical values is available at~\texttt{<a class="link-external link-http" href="http://web.ics.purdue.edu/~pasupath/" rel="external noopener nofollow">this http URL</a>}.

Inverse set estimation and inversion of simultaneous confidence intervals

Optimization-based frequentist confidence intervals for functionals in constrained inverse problems: Resolving the Burrus conjecture

Confidence Intervals and Hypothesis Testing for High-Dimensional Regression

Simultaneous Confidence Intervals for Several Inverse Gaussian Populations

Overlapping Batch Confidence Intervals on Statistical Functionals Constructed from Time Series: Application to Quantiles, Optimization, and Estimation

Conformal Counterfactual Inference under Hidden Confounding

Empirical Likelihood Confidence Intervals for Nonparametric Density Estimation

Conformal Inference for Invariant Risk Minimization

Simultaneous likelihood-based bootstrap confidence sets for a large number of models

Simultaneous Confidence Intervals for Partially Identified Parameters

Sample-constrained partial identification with application to selection bias

An accurate percentile method for parametric inference based on asymptotically biased estimators

Conformal Inverse Optimization

High Confidence Level Inference is Almost Free using Parallel Stochastic Optimization

Confidence surfaces for the mean of locally stationary functional time series

Concentration-based confidence intervals for U-statistics

Sparsified simultaneous confidence intervals for high-dimensional linear models

The Bayesian Infinitesimal Jackknife for Variance

Joint Coverage Regions: Simultaneous Confidence and Prediction Sets

Conformal Inference of Counterfactuals and Individual Treatment Effects