Minimizing Control for Credit Assignment with Strong Feedback

Alexander Meulemans,Matilde Tristany Farinha,Maria R. Cervera,João Sacramento,Benjamin F. Grewe

DOI: https://doi.org/10.48550/arXiv.2204.07249

2022-06-22

Abstract:The success of deep learning ignited interest in whether the brain learns hierarchical representations using gradient-based learning. However, current biologically plausible methods for gradient-based credit assignment in deep neural networks need infinitesimally small feedback signals, which is problematic in biologically realistic noisy environments and at odds with experimental evidence in neuroscience showing that top-down feedback can significantly influence neural activity. Building upon deep feedback control (DFC), a recently proposed credit assignment method, we combine strong feedback influences on neural activity with gradient-based learning and show that this naturally leads to a novel view on neural network optimization. Instead of gradually changing the network weights towards configurations with low output loss, weight updates gradually minimize the amount of feedback required from a controller that drives the network to the supervised output label. Moreover, we show that the use of strong feedback in DFC allows learning forward and feedback connections simultaneously, using learning rules fully local in space and time. We complement our theoretical results with experiments on standard computer-vision benchmarks, showing competitive performance to backpropagation as well as robustness to noise. Overall, our work presents a fundamentally novel view of learning as control minimization, while sidestepping biologically unrealistic assumptions.

Neural and Evolutionary Computing,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to achieve gradient - based credit assignment (CA) in deep neural networks while ensuring that the method is biologically plausible. Specifically, the paper focuses on how to use strong feedback signals in deep neural networks to drive network activities in order to supervise output labels while performing gradient - based learning. This is different from the traditional error back - propagation (BP) method, which requires infinitesimal feedback signals, which is biologically unrealistic, especially in noisy environments. In addition, existing methods based on strong - feedback control are mainly applied to single - layer recurrent neural networks and usually assume that the feedback weights are fixed, which limits their application in deep neural networks.

The paper proposes a new method - Deep Feedback Control under Strong - Feedback Control (Strong - DFC), which allows the use of strong - feedback influences in network activities while updating forward and feedback connections through local - spatial and temporal learning rules. This method can not only reduce the output loss but also minimize the amount of feedback required by the controller during the training process, thus providing a completely new perspective on neural network optimization. In this way, the Strong - DFC method overcomes the problem of synaptic plasticity mechanisms that require precise synchronization in traditional methods, making the learning process more biologically realistic.

In summary, the main goal of this paper is to develop a method that can effectively perform gradient - based credit assignment and is also biologically plausible, especially being able to learn in the presence of strong - feedback influences.