Abstract:While standard estimation assumes that all datapoints are from probability distribution of the same fixed parameters $\theta$, we will focus on maximum likelihood (ML) adaptive estimation for nonstationary time series: separately estimating parameters $\theta_T$ for each time $T$ based on the earlier values $(x_t)_{t<T}$ using (exponential) moving ML estimator $\theta_T=\arg\max_\theta l_T$ for $l_T=\sum_{t<T} \eta^{T-t} \ln(\rho_\theta (x_t))$ and some $\eta\in(0,1]$. Computational cost of such moving estimator is generally much higher as we need to optimize log-likelihood multiple times, however, in many cases it can be made inexpensive thanks to dependencies. We focus on such example: $\rho(x)\propto \exp(-|(x-\mu)/\sigma|^\kappa/\kappa)$ exponential power distribution (EPD) family, which covers wide range of tail behavior like Gaussian ($\kappa=2$) or Laplace ($\kappa=1$) distribution. It is also convenient for such adaptive estimation of scale parameter $\sigma$ as its standard ML estimation is $\sigma^\kappa$ being average $\|x-\mu\|^\kappa$. By just replacing average with exponential moving average: $(\sigma_{T+1})^\kappa=\eta(\sigma_T)^\kappa +(1-\eta)|x_T-\mu|^\kappa$ we can inexpensively make it adaptive. It is tested on daily log-return series for DJIA companies, leading to essentially better log-likelihoods than standard (static) estimation, with optimal $\kappa$ tails types varying between companies. Presented general alternative estimation philosophy provides tools which might be useful for building better models for analysis of nonstationary time-series.
What problem does this paper attempt to address?
This paper attempts to solve the parameter estimation problem in non - stationary time - series analysis. Specifically, the standard parameter estimation methods assume that all data points come from probability distributions with the same fixed parameters, which may not be applicable when dealing with non - stationary time - series. Therefore, this paper focuses on using the moving estimator for maximum - likelihood (ML) adaptive estimation, that is, estimating the parameter \(\theta_T\) separately for each time point \(T\), based on the data values \(x_t\) of previous time points \(t < T\).
### Main contributions of the paper:
1. **Proposed an adaptive estimation method**: By introducing the exponentially - weighted moving maximum - likelihood estimator, this method can better adapt to the changing characteristics of non - stationary time - series.
2. **Applied the exponential power distribution (Exponential Power Distribution, EPD)**: The EPD family covers different tail behaviors from the Gaussian distribution to the Laplace distribution and is suitable for a wider range of data types.
3. **Improved the computational efficiency of parameter estimation**: By replacing the average in the standard maximum - likelihood estimation with the exponentially - weighted moving average, the computational cost of the adaptive estimation is significantly reduced.
4. **Empirical analysis**: By testing the daily log - return data of the Dow Jones Industrial Average (DJIA) over 100 years, it shows that the adaptive estimation method has a significant improvement in log - likelihood compared to the static estimation method.
### Key formulas:
- **Moving log - likelihood function**:
\[
l_T=\sum_{t < T}\eta^{T - t}\ln(\rho_\theta(x_t))
\]
where \(\eta\in(0, 1]\) is a decay factor used to weaken the influence of old data points.
- **Update formula for the adaptive scale parameter \(\sigma\)**:
\[
(\sigma_{T + 1})^\kappa=\eta(\sigma_T)^\kappa+(1 - \eta)|x_T-\mu|^\kappa
\]
- **Probability density function (PDF) of the exponential power distribution**:
\[
\rho_{\kappa,\mu,\sigma}(x)=\frac{1}{2\sigma\kappa^{- 1/\kappa}\Gamma(1 + 1/\kappa)}\exp\left(-\frac{|x-\mu|^\kappa}{\kappa\sigma^\kappa}\right)
\]
### Conclusion:
By introducing the adaptive estimation method, especially using the exponential power distribution in non - stationary time - series, the paper significantly improves the log - likelihood of the model. The experimental results show that the adaptive estimation method performs well in dealing with actual financial data. In particular, there are significant differences in the optimal tail - behavior parameter \(\kappa\) for different companies, which indicates the importance of parameter changes in non - stationary time - series analysis.