Abstract:Bioinspired approaches tend to mimic some biological functions for the purpose of creating more efficient and robust systems. These can be implemented in both software and hardware designs. A neuromorphic software part can include, for example, Spiking Neural Networks (SNNs) or event-based representations. Regarding the hardware part, we can find different sensory systems, such as Dynamic Vision Sensors, touch sensors, and actuators, which are linked together through specific interface boards. To run real-time SNN models, specialised hardware such as SpiNNaker, Loihi, and TrueNorth have been implemented. However, neuromorphic computing is still in development, and neuromorphic platforms are still not easily accessible to researchers. In addition, for Neuromorphic Robotics, we often need specially designed and fabricated PCBs for communication with peripheral components and sensors. Therefore, we developed an all-in-one neuromorphic system that emulates neuromorphic computing by running a Virtual Machine on a conventional low-power CPU. The Virtual Machine includes Python and Brian2 simulation packages, which allow the running of SNNs, emulating neuromorphic hardware. An additional, significant advantage of using conventional hardware such as Raspberry Pi in comparison to purpose-built neuromorphic hardware is that we can utilise the built-in physical input–output (GPIO) and USB ports to directly communicate with sensors. As a proof of concept platform, a robotic goalkeeper has been implemented, using a Raspberry Pi 5 board and SNN model in Brian2. All the sensors, namely DVS128, with an infrared module as the touch sensor and Futaba S9257 as the actuator, were linked to a Raspberry Pi 5 board. We show that it is possible to simulate SNNs on a conventional low-power CPU running real-time tasks for low-latency and low-power robotic applications. Furthermore, the system excels in the goalkeeper task, achieving an overall accuracy of 84% across various environmental conditions while maintaining a maximum power consumption of 20 W. Additionally, it reaches 88% accuracy in the online controlled setup and 80% in the offline setup, marking an improvement over previous results. This work demonstrates that the combination of a conventional low-power CPU running a Virtual Machine with only selected software is a viable competitor to neuromorphic computing hardware for robotic applications.

Detection of Fast-Moving Objects with Neuromorphic Hardware

A Survey of Neuromorphic Computing Based on Spiking Neural Networks

Exploring Neuromorphic Computing Based on Spiking Neural Networks: Algorithms to Hardware

Neuromorphic Processing and Sensing: Evolutionary Progression of AI to Spiking

Real-Time Target Tracking System with Spiking Neural Networks Implemented on Neuromorphic Chips

Low-power event-based face detection with asynchronous neuromorphic hardware

Compiling Spiking Neural Networks to Neuromorphic Hardware

Classification and regression of spatio-temporal signals using NeuCube and its realization on SpiNNaker neuromorphic hardware

High-Speed Object Recognition Based on a Neuromorphic System

Low-Power Neuromorphic Hardware for Signal Processing Applications

Design Space Exploration of Hardware Spiking Neurons for Embedded Artificial Intelligence

Neuromorphic Near-Sensor Computing: From Event-Based Sensing to Edge Learning

A Digital Neuromorphic Hardware for Spiking Neural Network

An Implementation of Communication, Computing and Control Tasks for Neuromorphic Robotics on Conventional Low-Power CPU Hardware

Advancements in Algorithms and Neuromorphic Hardware for Spiking Neural Networks

Direct Training of Hardware-Friendly Weight Binarized Spiking Neural Network with Surrogate Gradient Learning Towards Spatio-Temporal Event-Based Dynamic Data Recognition

R-SNN: Region-Based Spiking Neural Network for Object Detection

A High Energy-Efficiency Multi-core Neuromorphic Architecture for Deep SNN Training

SpikeNC: an Accurate and Scalable Simulator for Spiking Neural Network on Multi-Core Neuromorphic Hardware

Embedded event based object detection with spiking neural network

A Hybrid Neuromorphic Object Tracking and Classification Framework for Real-time Systems