Abstract:The brain functions as a spatio-temporal information processing machine. Spatio- and spectro-temporal brain data (STBD) are the most commonly collected data for measuring brain response to external stimuli. An enormous amount of such data has been already collected, including brain structural and functional data under different conditions, molecular and genetic data, in an attempt to make a progress in medicine, health, cognitive science, engineering, education, neuro-economics, Brain-Computer Interfaces (BCI), and games. Yet, there is no unifying computational framework to deal with all these types of data in order to better understand this data and the processes that generated it. Standard machine learning techniques only partially succeeded and they were not designed in the first instance to deal with such complex data. Therefore, there is a need for a new paradigm to deal with STBD. This paper reviews some methods of spiking neural networks (SNN) and argues that SNN are suitable for the creation of a unifying computational framework for learning and understanding of various STBD, such as EEG, fMRI, genetic, DTI, MEG, and NIRS, in their integration and interaction. One of the reasons is that SNN use the same computational principle that generates STBD, namely spiking information processing. This paper introduces a new SNN architecture, called NeuCube, for the creation of concrete models to map, learn and understand STBD. A NeuCube model is based on a 3D evolving SNN that is an approximate map of structural and functional areas of interest of the brain related to the modeling STBD. Gene information is included optionally in the form of gene regulatory networks (GRN) if this is relevant to the problem and the data. A NeuCube model learns from STBD and creates connections between clusters of neurons that manifest chains (trajectories) of neuronal activity. Once learning is applied, a NeuCube model can reproduce these trajectories, even if only part of the input STBD or the stimuli data is presented, thus acting as an associative memory. The NeuCube framework can be used not only to discover functional pathways from data, but also as a predictive system of brain activities, to predict and possibly, prevent certain events. Analysis of the internal structure of a model after training can reveal important spatio-temporal relationships 'hidden' in the data. NeuCube will allow the integration in one model of various brain data, information and knowledge, related to a single subject (personalized modeling) or to a population of subjects. The use of NeuCube for classification of STBD is illustrated in a case study problem of EEG data. NeuCube models result in a better accuracy of STBD classification than standard machine learning techniques. They are robust to noise (so typical in brain data) and facilitate a better interpretation of the results and understanding of the STBD and the brain conditions under which data was collected. Future directions for the use of SNN for STBD are discussed.

A Spiking Neural Network Model for Obstacle Avoidance in Simulated Prosthetic Vision

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

A Retinotopic Spiking Neural Network System for Accurate Recognition of Moving Objects Using NeuCube and Dynamic Vision Sensors

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

Efficient Point-Process Modeling of Spiking Neurons for Neuroprosthesis

Spiking neural network-based navigation and obstacle avoidance algorithm for complex scenes

Spiking neural networks: Towards bio-inspired multimodal perception in robotics

Event-Enhanced Multi-Modal Spiking Neural Network for Dynamic Obstacle Avoidance

A Parallel Spiking Neural Network Based on Adaptive Lateral Inhibition Mechanism for Objective Recognition

A Neuromorphic Approach to Obstacle Avoidance in Robot Manipulation

NeuroSEE: A Neuromorphic Energy-Efficient Processing Framework for Visual Prostheses.

Event-based Video Reconstruction via Potential-assisted Spiking Neural Network

Maximum Entropy Intrinsic Learning for Spiking Networks Towards Embodied Neuromorphic Vision

A dynamic vision sensor object recognition model based on trainable event-driven convolution and spiking attention mechanism

A Bio-Inspired Hierarchical Spiking Neural Network With Reward-Modulated STDP Learning Rule for AER Object Recognition

Image Processing Strategies Based on Deep Neural Network for Simulated Prosthetic Vision

Classification and regression of spatio-temporal signals using NeuCube and its realization on SpiNNaker neuromorphic hardware

Efficient multi-scale representation of visual objects using a biologically plausible spike-latency code and winner-take-all inhibition

NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data

NeuSpike-Net: High Speed Video Reconstruction via Bio-inspired Neuromorphic Cameras