Abstract:<p>Machine learning is yielding unprecedented interest in research and industry, due to recent success in many applied contexts such as image classification and object recognition. However, the deployment of these systems requires huge computing capabilities, thus making them unsuitable for embedded systems. To deal with this limitation, many researchers are investigating brain-inspired computing, which would be a perfect alternative to the conventional Von Neumann architecture based computers (CPU/GPU) that meet the requirements for computing performance, but not for energy-efficiency. Therefore, neuromorphic hardware circuits that are adaptable for both parallel and distributed computations need to be designed. In this paper, we focus on Spiking Neural Networks (SNNs) with a comprehensive study of information coding methods and hardware exploration. In this context, we propose a framework for neuromorphic hardware design space exploration, which allows to define a suitable architecture based on application-specific constraints and starting from a wide variety of possible architectural choices. For this framework, we have developed a behavioral level simulator for neuromorphic hardware architectural exploration named NAXT. Moreover, we propose modified versions of the standard Rate Coding technique to make trade-offs with the Time Coding paradigm, which is characterized by the low number of spikes propagating in the network. Thus, we are able to reduce the number of spikes while keeping the same neuron's model, which results in an SNN with fewer events to process. By doing so, we seek to reduce the amount of power consumed by the hardware. Furthermore, we present three neuromorphic hardware architectures in order to quantitatively study the implementation of SNNs. One of these architectures integrates a novel hybrid structure: a highly-parallel computation core for most solicited layers, and time-multiplexed computation units for deeper layers. These architectures are derived from a novel funnel-like Design Space Exploration framework for neuromorphic hardware.</p>

ANAS: Asynchronous Neuromorphic Hardware Architecture Search Based on a System-Level Simulator.

ANCoEF: Asynchronous Neuromorphic Algorithm/Hardware Co-Exploration Framework with a Fully Asynchronous Simulator

A Realistic Simulation Framework for Analog/Digital Neuromorphic Architectures

HSCoNAS: Hardware-Software Co-Design of Efficient DNNs Via Neural Architecture Search

Co-Exploring Neural Architecture and Network-on-Chip Design for Real-Time Artificial Intelligence

Demonstrating the Advantages of Analog Wafer-Scale Neuromorphic Hardware

NAAS: Neural Accelerator Architecture Search

Hardware Aware Evolutionary Neural Architecture Search using Representation Similarity Metric

Multi-Objective Architecture Search and Optimization for Heterogeneous Neuromorphic Architecture

Design Space Exploration of Hardware Spiking Neurons for Embedded Artificial Intelligence

NeuCASL: From Logic Design to System Simulation of Neuromorphic Engines

Extensible neuromorphic computing simulator based on a programmable hardware

Co-Exploration of Neural Architectures and Heterogeneous ASIC Accelerator Designs Targeting Multiple Tasks

FPGA Based Emulation Environment for Neuromorphic Architectures

ON-OFF Neuromorphic ISING Machines using Fowler-Nordheim Annealers

INSIGHT: Universal Neural Simulator for Analog Circuits Harnessing Autoregressive Transformers

Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search

NEUTRAMS: Neural Network Transformation and Co-Design under Neuromorphic Hardware Constraints

EPHA: An Energy-efficient Parallel Hybrid Architecture for ANNs and SNNs

AIsim: Functional Simulator for Analog-to-Information Perceptual Systems

Automating Analogue AI Chip Design with Genetic Search