Abstract:The autoregressive (AR) model is a widely used model to understand time series data. Traditionally, the innovation noise of the AR is modeled as Gaussian. However, many time series applications, for example, financial time series data, are non-Gaussian, therefore, the AR model with more general heavy-tailed innovations is preferred. Another issue that frequently occurs in time series is missing values, due to system data record failure or unexpected data loss. Although there are numerous works about Gaussian AR time series with missing values, as far as we know, there does not exist any work addressing the issue of missing data for the heavy-tailed AR model. In this paper, we consider this issue for the first time, and propose an efficient framework for parameter estimation from incomplete heavy-tailed time series based on a stochastic approximation expectation maximization (SAEM) coupled with a Markov Chain Monte Carlo (MCMC) procedure. The proposed algorithm is computationally cheap and easy to implement. The convergence of the proposed algorithm to a stationary point of the observed data likelihood is rigorously proved. Extensive simulations and real datasets analyses demonstrate the efficacy of the proposed framework.

Maximum Likelihood Parameter Estimation for ARMAX Models Based on Stochastic Gradient Algorithm

Recursive Maximum Likelihood Method for the Identification of Hammerstein ARMAX System

Parameter identification based on adaptive density estimation

Parameter Identification of ARX Models Based on Modified Momentum Gradient Descent Algorithm

Latest Estimation Based Recursive Stochastic Gradient Identification Algorithms for Arx Models

Maximum likelihood based multi‐innovation stochastic gradient identification algorithms for bilinear stochastic systems with ARMA noise

Aitken-Based Stochastic Gradient Algorithm for ARX Models with Time Delay

Weighted Hierarchical Stochastic Gradient Identification Algorithms for ARX Models

Modified Kalman Filtering Based Multi-Step-length Gradient Iterative Algorithm for ARX Models with Random Missing Outputs

Estimating unknown probability density functions for random parameters of stochastic ARMAX systems

Variational Bayesian-Based Iterative Algorithm for ARX Models with Random Missing Outputs

Latest-Estimation Based Hierarchical Recursive Extended Least Squares Algorithm for Armax Model

Gradient-based parameter estimation for input nonlinear systems with ARMA noises based on the auxiliary model

Gradient-based simulated maximum likelihood estimation for Lévy-driven Ornstein–Uhlenbeck stochastic volatility models

Fractional-Based Stochastic Gradient Algorithms for Time-Delayed ARX Models.

Detection of Outliers in ARMAX Time Series Models

Parameter estimation for a class of radial basis function-based nonlinear time-series models with moving average noises

Identification of ARMAX based on genetic algorithm

Adaptive Accelerated Proximal Gradient Algorithm for Auto-Regressive Exogenous Models with Outliers

Parameter Estimation of Heavy-Tailed AR Model with Missing Data via Stochastic EM

A Novel Maximum Likelihood-Based Stochastic Gradient Algorithm for Hammerstein Nonlinear Systems with Coloured Noise.