Abstract:Estimation of autocorrelations and spectral densities is of fundamental importance in many fields of science, from identifying pulsar signals in astronomy to measuring heart beats in medicine. In circumstances where one is interested in specific autocorrelation functions that do not fit into any simple families of models, such as auto-regressive moving average (ARMA), estimating model parameters is generally approached in one of two ways: by fitting the model autocorrelation function to a non-parameteric autocorrelation estimate via regression analysis or by fitting the model autocorrelation function directly to the data via maximum likelihood. Prior literature suggests that variogram regression yields parameter estimates of comparable quality to maximum likelihood. In this letter we demonstrate that, as sample size is increases, the accuracy of the maximum-likelihood estimates (MLE) ultimately improves by orders of magnitude beyond that of variogram regression. For relatively continuous and Gaussian processes, this improvement can occur for sample sizes of less than 100. Moreover, even where the accuracy of these methods is comparable, the MLE remains almost universally better and, more critically, variogram regression does not provide reliable confidence intervals. Inaccurate regression parameter estimates are typically accompanied by underestimated standard errors, whereas likelihood provides reliable confidence intervals.

Exact Maximum Likelihood Estimation of an ARMA(1, 1) Model with Incomplete Data

STATISTICAL INFERENCE FOR MEASUREMENT EQUATION SELECTION IN THE LOG-REALGARCH MODEL

Recursive Maximum Likelihood Method for the Identification of Hammerstein ARMAX System

Miscellanea. on the Exact Likelihood Function of a Multivariate Autoregressive Moving Average Model

NON‐STATIONARITY AND QUASI‐MAXIMUM LIKELIHOOD ESTIMATION ON A DOUBLE AUTOREGRESSIVE MODEL

State Space Estimation for Long Memory ARFIMA-GARCH Models

Mildly Explosive Autoregression with Anti-persistent Errors

Parameter Estimation of Heavy-Tailed AR Model with Missing Data via Stochastic EM

Modeling for a Class of Nonstationary ARMA Series 1

Parameter-Covariance Maximum Likelihood Estimation

An Explicit Formula for Likelihood Function for Gaussian Vector Autoregressive Moving-Average Model Conditioned on Initial Observables with Application to Model Calibration

Maximum likelihood inference for a class of discrete-time Markov-switching time series models with multiple delays

On the estimators of autocorrelation model parameters

Auxiliary model maximum likelihood least squares-based iterative algorithm for multivariable autoregressive output-error autoregressive moving average systems

On scalable ARMA models

Maximum likelihood estimation for α -stable double autoregressive models

Parameter identification based on adaptive density estimation

Maximum Likelihood from Incomplete Data Via the EM Algorithm

Identification of ARMA Models Using Intermittent and Quantized Output Observations

Maximum Empirical Likelihood Estimation of Continuous-Time Models with Conditional Characteristic Functions

ARMA model order determination based on the eigenvalues of the overdetermined instrumental variable product moment