Abstract:Predictive linear and nonlinear models based on kernel machines or deep neural networks have been used to discover dependencies among time series. This paper proposes an efficient nonlinear modeling approach for multiple time series, with a complexity comparable to linear vector autoregressive (VAR) models while still incorporating nonlinear interactions among different time-series variables. The modeling assumption is that the set of time series is generated in two steps: first, a linear VAR process in a latent space, and second, a set of invertible and Lipschitz continuous nonlinear mappings that are applied per sensor, that is, a component-wise mapping from each latent variable to a variable in the measurement space. The VAR coefficient identification provides a topology representation of the dependencies among the aforementioned variables. The proposed approach models each component-wise nonlinearity using an invertible neural network and imposes sparsity on the VAR coefficients to reflect the parsimonious dependencies usually found in real applications. To efficiently solve the formulated optimization problems, a custom algorithm is devised combining proximal gradient descent, stochastic primal-dual updates, and projection to enforce the corresponding constraints. Experimental results on both synthetic and real data sets show that the proposed algorithm improves the identification of the support of the VAR coefficients in a parsimonious manner while also improving the time-series prediction, as compared to the current state-of-the-art methods.

The nonlinear feature extraction with parsimonious components based on multiple Kernel function

Adaptive Kpca Modeling of Nonlinear Systems

Cross-validatory Framework for Optimal Parameter Estimation of KPCA and KPLS Models

Adaptive kernel subspace method for speeding up feature extraction

Sparse Kernel Feature Extraction Via Support Vector Learning.

Nonlinear Mapping and Feature Extraction: KMSE Model and Kernel Principal Component Analysis Technique

Nonlinear Process Monitoring Using Improved Kernel Principal Component Analysis

System Model Identification Based on Kernel Function

Learning a Data-Dependent Kernel Function for KPCA-based Nonlinear Process Monitoring

SVM Modeling and Application Based on Kernel Function Principal Component Analysis

Nonlinear Feature Extraction for Soft Sensor Modeling Based on Weighted Probabilistic PCA

Phase Space Reconstruction of Nonlinear Time Series Based on Kernel Method

KPCA Based SVM Identification of Nonlinear System

An Iterative Algorithm for Robust Kernel Principal Component Analysis

A Fast KPCA-based Nonlinear Feature Extraction Method

On Feature Extraction Via Kernels

KPCA Based on Cultural Algorithms Feature Extraction

Nonlinear Process Monitoring Based on Maximum Variance Unfolding Projections.

Nonlinear Time Series Prediction Modeling Based on Kernel Method

Efficient Interpretable Nonlinear Modeling for Multiple Time Series

An Improved Algorithm for Kernel Principal Component Analysis