If deep learning is the answer, then what is the question?

Andrew Saxe,Stephanie Nelli,Christopher Summerfield
DOI: https://doi.org/10.48550/arXiv.2004.07580
2020-04-17
Abstract:Neuroscience research is undergoing a minor revolution. Recent advances in machine learning and artificial intelligence (AI) research have opened up new ways of thinking about neural computation. Many researchers are excited by the possibility that deep neural networks may offer theories of perception, cognition and action for biological brains. This perspective has the potential to radically reshape our approach to understanding neural systems, because the computations performed by deep networks are learned from experience, not endowed by the researcher. If so, how can neuroscientists use deep networks to model and understand biological brains? What is the outlook for neuroscientists who seek to characterise computations or neural codes, or who wish to understand perception, attention, memory, and executive functions? In this Perspective, our goal is to offer a roadmap for systems neuroscience research in the age of deep learning. We discuss the conceptual and methodological challenges of comparing behaviour, learning dynamics, and neural representation in artificial and biological systems. We highlight new research questions that have emerged for neuroscience as a direct consequence of recent advances in machine learning.
Neurons and Cognition
What problem does this paper attempt to address?
This paper attempts to explore the application of deep learning in neuroscience research as well as the challenges and opportunities it brings. Specifically, the authors focus on how to use deep neural networks to simulate and understand the perception, cognition and behavior of the biological brain. The main questions of the paper can be summarized as follows: 1. **The Possibility of Deep Learning as a Neural Computation Theory**: Can deep - learning models provide effective theoretical explanations for perception, cognition and behavior in the biological brain? How can these models help neuroscientists understand the computational mechanisms of the nervous system? 2. **Methodological and Conceptual Challenges**: How to compare behavior, learning dynamics and neural representations between artificial and biological systems? What statistical and technical difficulties does this comparison face? 3. **New Research Directions**: How can the deep - learning framework guide neuroscientists to propose new and verifiable hypotheses? How to design deep - network models that are more in line with biological reality? 4. **The Equivalence between Deep Networks and the Biological Brain**: Can deep networks learn neural representations and computational mechanisms similar to those of the biological brain? To what extent does this equivalence hold? 5. **Theoretical Understanding and Model Explanation**: How to understand the learning process and internal mechanisms of deep networks through idealized models? Can these models provide specific predictions for complex neural phenomena? 6. **Learning Rules and Perception Systems**: How do different learning rules (such as supervised learning, unsupervised learning and reinforcement learning) affect the learning process of deep networks? Can these rules explain certain empirical phenomena in the biological brain? In summary, the core issue of this paper is to explore the application potential of deep learning in neuroscience and how to overcome relevant theoretical and technical challenges in order to better understand the computational mechanisms of the biological brain.