Abstract:<p>Machine learning is yielding unprecedented interest in research and industry, due to recent success in many applied contexts such as image classification and object recognition. However, the deployment of these systems requires huge computing capabilities, thus making them unsuitable for embedded systems. To deal with this limitation, many researchers are investigating brain-inspired computing, which would be a perfect alternative to the conventional Von Neumann architecture based computers (CPU/GPU) that meet the requirements for computing performance, but not for energy-efficiency. Therefore, neuromorphic hardware circuits that are adaptable for both parallel and distributed computations need to be designed. In this paper, we focus on Spiking Neural Networks (SNNs) with a comprehensive study of information coding methods and hardware exploration. In this context, we propose a framework for neuromorphic hardware design space exploration, which allows to define a suitable architecture based on application-specific constraints and starting from a wide variety of possible architectural choices. For this framework, we have developed a behavioral level simulator for neuromorphic hardware architectural exploration named NAXT. Moreover, we propose modified versions of the standard Rate Coding technique to make trade-offs with the Time Coding paradigm, which is characterized by the low number of spikes propagating in the network. Thus, we are able to reduce the number of spikes while keeping the same neuron's model, which results in an SNN with fewer events to process. By doing so, we seek to reduce the amount of power consumed by the hardware. Furthermore, we present three neuromorphic hardware architectures in order to quantitatively study the implementation of SNNs. One of these architectures integrates a novel hybrid structure: a highly-parallel computation core for most solicited layers, and time-multiplexed computation units for deeper layers. These architectures are derived from a novel funnel-like Design Space Exploration framework for neuromorphic hardware.</p>

Hyperseed: Unsupervised Learning with Vector Symbolic Architectures

Hyperdimensional Computing with Spiking-Phasor Neurons

Cognitive modeling and learning with sparse binary hypervectors

Self-Attention Based Semantic Decomposition in Vector Symbolic Architectures

Vector Symbolic Architectures as a Computing Framework for Emerging Hardware

Unsupervised Learning of Neurosymbolic Encoders

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Residual and Attentional Architectures for Vector-Symbols

LARS-VSA: A Vector Symbolic Architecture For Learning with Abstract Rules

Efficient Hyperdimensional Computing With Spiking Phasors

Hyperdimensional Computing With Local Binary Patterns: One-Shot Learning of Seizure Onset and Identification of Ictogenic Brain Regions Using Short-Time iEEG Recordings

Neuromorphic Extreme Learning Machines with Bimodal Memristive Synapses

Sobol Sequence Optimization for Hardware-Efficient Vector Symbolic Architectures

Self-Organising Neural Discrete Representation Learning à la Kohonen

Fast-Learning and High-Robustness Unsupervised Spiking Neural Networks with a Highly Parallel Inception-like Architecture

Holographic Graph Neuron: a Bio-Inspired Architecture for Pattern Processing

Neuromorphic Visual Scene Understanding with Resonator Networks

Spiking Hyperdimensional Network: Neuromorphic Models Integrated with Memory-Inspired Framework

Gluing Neural Networks Symbolically Through Hyperdimensional Computing

Design Space Exploration of Hardware Spiking Neurons for Embedded Artificial Intelligence