Abstract:While standard estimation assumes that all datapoints are from probability distribution of the same fixed parameters $\theta$, we will focus on maximum likelihood (ML) adaptive estimation for nonstationary time series: separately estimating parameters $\theta_T$ for each time $T$ based on the earlier values $(x_t)_{t<T}$ using (exponential) moving ML estimator $\theta_T=\arg\max_\theta l_T$ for $l_T=\sum_{t<T} \eta^{T-t} \ln(\rho_\theta (x_t))$ and some $\eta\in(0,1]$. Computational cost of such moving estimator is generally much higher as we need to optimize log-likelihood multiple times, however, in many cases it can be made inexpensive thanks to dependencies. We focus on such example: $\rho(x)\propto \exp(-|(x-\mu)/\sigma|^\kappa/\kappa)$ exponential power distribution (EPD) family, which covers wide range of tail behavior like Gaussian ($\kappa=2$) or Laplace ($\kappa=1$) distribution. It is also convenient for such adaptive estimation of scale parameter $\sigma$ as its standard ML estimation is $\sigma^\kappa$ being average $\|x-\mu\|^\kappa$. By just replacing average with exponential moving average: $(\sigma_{T+1})^\kappa=\eta(\sigma_T)^\kappa +(1-\eta)|x_T-\mu|^\kappa$ we can inexpensively make it adaptive. It is tested on daily log-return series for DJIA companies, leading to essentially better log-likelihoods than standard (static) estimation, with optimal $\kappa$ tails types varying between companies. Presented general alternative estimation philosophy provides tools which might be useful for building better models for analysis of nonstationary time-series.

Adaptively Aggregated Forecast for Exponential Family Panel Model

An Ensemble Forecasting Method For The Aggregated Load With Subprofiles

Adaptively combined forecasting for discrete response time series

Temporal aggregation of equity return time-series models

Forecasting with Dynamic Panel Data Models

Algorithmic Robust Forecast Aggregation

Adaptive Aggregation for Longitudinal Quantile Regression Based on Censored History Process.

Jackknife Model Averaging for Additive Expectile Prediction

An Adaptive Ensemble Data Driven Approach for Nonparametric Probabilistic Forecasting of Electricity Load

Expert Aggregation for Financial Forecasting

To Pool Or Not To Pool: What Is A Good Strategy For Parameter Estimation And Forecasting In Panel Regressions?

Online aggregation of probability forecasts with confidence

Adaptive exponential power distribution with moving estimator for nonstationary time series

A Novel Robust Structural Quadratic Forecasting Model and Applications

A dynamic financial distress forecast model with multiple forecast results under unbalanced data environment

Dynamic partial (co)variance forecasting model

Adaptive Conformal Predictions for Time Series

Score-driven Exponentially Weighted Moving Averages and Value-at-Risk Forecasting

Model Averaging for Prediction with Fragmentary Data

Coherent Forecasting for a Mixed Integer-Valued Time Series Model

Asymmetric exponential power Bayesian median autoregression with applications