Abstract:Closed-loop neurotechnologies often need to adaptively learn an encoding model that relates the neural activity to the brain state, and is used for brain state decoding. The speed and accuracy of adaptive learning algorithms are critically affected by the learning rate, which dictates how fast model parameters are updated based on new observations. Despite the importance of the learning rate, currently an analytical approach for its selection is largely lacking and existing signal processing methods vastly tune it empirically or heuristically. Here, we develop a novel analytical calibration algorithm for optimal selection of the learning rate in adaptive Bayesian filters. We formulate the problem through a fundamental trade-off that learning rate introduces between the steady-state error and the convergence time of the estimated model parameters. We derive explicit functions that predict the effect of learning rate on error and convergence time. Using these functions, our calibration algorithm can keep the steady-state parameter error covariance smaller than a desired upper-bound while minimizing the convergence time, or keep the convergence time faster than a desired value while minimizing the error. We derive the algorithm both for discrete-valued spikes modeled as point processes nonlinearly dependent on the brain state, and for continuous-valued neural recordings modeled as Gaussian processes linearly dependent on the brain state. Using extensive closed-loop simulations, we show that the analytical solution of the calibration algorithm accurately predicts the effect of learning rate on parameter error and convergence time. Moreover, the calibration algorithm allows for fast and accurate learning of the encoding model and for fast convergence of decoding to accurate performance. Finally, larger learning rates result in inaccurate encoding models and decoders, and smaller learning rates delay their convergence. The calibration algorithm provides a novel analytical approach to predictably achieve a desired level of error and convergence time in adaptive learning, with application to closed-loop neurotechnologies and other signal processing domains.

Adaptive Algorithm of Learning Rate for Feedforward Neural Network

Dynamic node creation and fast learning algorithm for a hybrid feedforward neural network

Study on an Improved Neural Networks and Its Adaptive Learning Rate

An online learning algorithm with adaptive forgetting factors for feedforward neural networks in financial time series forecasting

A Fast Learning Algorithm for Feedfoward Neural Network Based on the Layer-by-Layer and Neuron-by-Neuron Optimizing Procedure

Optimizing the learning rate for adaptive estimation of neural encoding models

Dynamic Learning Rate for Neural Networks: A Fixed-Time Stability Approach

Train Feedfoward Neural Network with Layer-wise Adaptive Rate via Approximating Back-matching Propagation

An Adaptive Mechanism to Achieve Learning Rate Dynamically

Train feedfoward neural network with layer-wise adaptive rate via approximating back-matching propagation

LLR: Learning Learning Rates by LSTM for Training Neural Networks.

Optimal Algorithm for a Multilayer Feedforward Net and Its Application

Learning Algorithm for Neural Networks Based upon Continuous-time System Simulation

Study of applied learning rates of recurrent neural networks

A Fast Hybrid Algorithm Of Global Optimization For Feedforward Neural Networks

Differentiable Self-Adaptive Learning Rate

A New Dynamic Optimal Learning Rate for a Two-Layer Neural Network

An Improved Levenberg-Marquardt Algorithm with Adaptive Learning Rate for Rbf Neural Network

A Kind of Neural Network Adaptive Consol Algorithm

Fuzzy Neural Network Adaptive Control Based on Fast Parameters Learning Algorithm

Barzilai-Borwein-based Adaptive Learning Rate for Deep Learning