Abstract:Abstract Long-term forecasting involves predicting a horizon that is far ahead of the last observation. It is a problem of high practical relevance, for instance for companies in order to decide upon expensive long-term investments. Despite the recent progress and success of Gaussian processes (GPs) based on spectral mixture kernels, long-term forecasting remains a challenging problem for these kernels because they decay exponentially at large horizons. This is mainly due to their use of a mixture of Gaussians to model spectral densities. Characteristics of the signal important for long-term forecasting can be unravelled by investigating the distribution of the Fourier coefficients of (the training part of) the signal, which is non-smooth, heavy-tailed, sparse, and skewed. The heavy tail and skewness characteristics of such distributions in the spectral domain allow to capture long-range covariance of the signal in the time domain. Motivated by these observations, we propose to model spectral densities using a skewed Laplace spectral mixture (SLSM) due to the skewness of its peaks, sparsity, non-smoothness, and heavy tail characteristics. By applying the inverse Fourier Transform to this spectral density we obtain a new GP kernel for long-term forecasting. In addition, we adapt the lottery ticket method, originally developed to prune weights of a neural network, to GPs in order to automatically select the number of kernel components. Results of extensive experiments, including a multivariate time series, show the beneficial effect of the proposed SLSM kernel for long-term extrapolation and robustness to the choice of the number of mixture components.

A Gaussian Process Regression Model for Distribution Inputs

Sliced Wasserstein Kernels for Probability Distributions

Feature-fusion-kernel-based Gaussian Process Model for Probabilistic Long-Term Load Forecasting

Vecchia Gaussian Processes: Probabilistic Properties, Minimax Rates and Methodological Developments

Multivariate Gaussian and Student$-t$ Process Regression for Multi-output Prediction

Gromov-Wasserstein-like Distances in the Gaussian Mixture Models Space

The bilateral generalized inverse Gaussian process with applications to financial modeling

The Properties of Fractional Gaussian Process and Their Applications

Bivariate Gaussian models for wind vectors in a distributional regression framework

Inference for Gaussian Processes with Matérn Covariogram on Compact Riemannian Manifolds

Intrinsic Gaussian Process on Unknown Manifolds with Probabilistic Metrics

Gaussian Approximation and Moderate Deviations of Poisson Shot Noises with Application to Compound Generalized Hawkes Processes

Gaussian processes with skewed Laplace spectral mixture kernels for long-term forecasting

Mixture of Gaussian Processes and its Applications

Introduction To Gaussian Process Regression In Bayesian Inverse Problems, With New ResultsOn Experimental Design For Weighted Error Measures

Integral Transforms from Finite Data: An Application of Gaussian Process Regression to Fourier Analysis

Optimal transport for Gaussian mixture models

Load forecasting using Twin Gaussian Process model

Fully Bayesian Differential Gaussian Processes through Stochastic Differential Equations

Deep Gaussian Processes with Importance-Weighted Variational Inference