Abstract:Accurate channel state information (CSI) is important for MIMO systems, especially in a high-speed scenario, fast time-varying CSI tends to be out of date, and a change in CSI shows complex nonlinearities. The kernel recursive least-squares (KRLS) algorithm, which offers an attractive framework to deal with nonlinear problems, can be used in predicting nonlinear time-varying CSI. However, the network structure of the traditional KRLS algorithm grows as the training sample size increases, resulting in insufficient storage space and increasing computation when dealing with incoming data, which limits the online prediction of the KRLS algorithm. This paper proposed a new sparse sliding-window KRLS (SSW-KRLS) algorithm where a candidate discard set is selected through correlation analysis between the mapping vectors in the kernel Hilbert spaces of the new input sample and the existing samples in the kernel dictionary; then, the discarded sample is determined in combination with its corresponding output to achieve dynamic sample updates. Specifically, the proposed SSW-KRLS algorithm maintains the size of the kernel dictionary within the sample budget requires a fixed amount of memory and computation per time step, incorporates regularization, and achieves online prediction. Moreover, in order to sufficiently track the strongly changeable dynamic characteristics, a forgetting factor is considered in the proposed algorithm. Numerical simulations demonstrate that, under a realistic channel model of 3GPP in a rich scattering environment, our proposed algorithm achieved superior performance in terms of both predictive accuracy and kernel dictionary size than that of the ALD-KRLS algorithm. Our proposed SSW-KRLS algorithm with M=90 achieved 2 dB NMSE less than that of the ALD-KRLS algorithm with v=0.001, while the kernel dictionary was about 17% smaller when the speed of the mobile user was 120 km/h.

Multikernel Recursive Least-Squares Temporal Difference Learning

Kernel Recursive Least-Squares Temporal Difference Algorithms With Sparsification And Regularization

Kernel Least-Squares Temporal Difference Learning

A Unified Approach for Multi-step Temporal-Difference Learning with Eligibility Traces in Reinforcement Learning

Sparse Kernel-Based Least Squares Temporal Difference with Prioritized Sweeping.

Compressed kernelized least squares temporal difference learning via random projections

A sparse kernel-based least-squares temporal difference algorithm for reinforcement learning

Orthogonal Matching Pursuit for Least Squares Temporal Difference with Gradient Correction

Online Selective Kernel-Based Temporal Difference Learning

Online Sparse Temporal Difference Learning Based on Nested Optimization and Regularized Dual Averaging.

Online attentive kernel-based temporal difference learning

Average Reward Multi-Step Temporal-Difference Learning Using Recursive Least-Squares Methods

Recursive least-squares TD (λ) learning algorithm based on improved extreme learning machine

Deep Reinforcement Learning Using Least‐squares Truncated Temporal‐difference

Sparse Sliding-Window Kernel Recursive Least-Squares Channel Prediction for Fast Time-Varying MIMO Systems

Least-Squares Temporal Difference Learning for the Linear Quadratic Regulator

Online Time Series Prediction Based Modified Kernel Recursive Least-Squares from Random Projection and Adaptive Update.

The surprising efficiency of temporal difference learning for rare event prediction

Online Prediction of Noisy Time Series: Dynamic Adaptive Sparse Kernel Recursive Least Squares from Sparse and Adaptive Tracking Perspective

Gradient Descent Temporal Difference-Difference Learning

Statistical Inference for Temporal Difference Learning with Linear Function Approximation