Abstract:Limited by visual percepts elicited by existing visual prosthesis, its necessary to enhance its functionality to fulfill some challenging tasks for the blind such as obstacle avoidance. This paper argues that spiking neural networks (SNN) are effective techniques for object recognition and introduces for the first time a SNN model for obstacle recognition to assist blind people wearing prosthetic vision devices by modelling and classifying spatio-temporal (ST) video data. The proposed methodology is based on a novel spiking neural network architecture, called NeuCube as a general framework for video data modelling in simulated prosthetic vision. As an integrated environment including spiking trains encoding, input variable mapping, unsupervised reservoir training and supervised classifier training, the NeuCube consists of a spiking neural network reservoir (SNNr) and a dynamic evolving spiking neural network classifier (deSNN). First, input data is captured by visual prosthesis, then ST feature extraction is utilized in the low-resolution prosthetic vision generated by prostheses. Finally such ST features are fed to the NeuCube to output classification result of obstacle analysis for an early warning system to be activated. Experiments on collected video data and comparison with other computational intelligence methods indicate promising results. This makes it possible to directly utilize available neuromorphic hardware chips, embedded in visual prostheses, to enhance significantly their functionality. The proposed NeuCube-based obstacle avoidance methodology provides useful guidance to the blind, thus offering a significant improvement of current prostheses and potentially benefiting future prosthesis wearers.

Spiking neural network-based navigation and obstacle avoidance algorithm for complex scenes

Event-Enhanced Multi-Modal Spiking Neural Network for Dynamic Obstacle Avoidance

A Target-Reaching Controller for Mobile Robots Using Spiking Neural Networks

A Navigation Cognitive System Driven by Hierarchical Spiking Neural Network.

A Spiking Neural Network Model for Obstacle Avoidance in Simulated Prosthetic Vision

Spiking Reinforcement Learning with Memory Ability for Mapless Navigation

Population-coded Spiking Neural Network with Reinforcement Learning for Mapless Navigation

A Neural Network-Based Navigation Approach for Autonomous Mobile Robot Systems

A Neural Networks Algorithm for Robot Path Planning in Unknown Environment

Obstacle Avoidance Algorithm Via Hierarchical Interaction Deep Reinforcement Learning

A Spiking Neural Network With Dynamic Memory For A Real Autonomous Mobile Robot In Dynamic Environment

Autonomous Driving with Spiking Neural Networks

A Campus Scene Navigation Scheme Based on MPCC Dynamic Obstacle Avoidance Method

Use-Dependent Synaptic Connection Modification In Snn Generating Autonomous Behavior In A Khepera Mobile Robot

The Curved Openspace Algorithm and a Spike-Latency Model for Sonar-Based Obstacle Avoidance

Differential mapping spiking neural network for sensor-based robot control

Self-Organization of Spiking Neural Network Generating Autonomous Behavior in a Real Mobile Robot

SafeCrowdNav: safety evaluation of robot crowd navigation in complex scenes

A Review of Recent Advances and Application for Spiking Neural Networks

A Brain-Inspired Goal-Oriented Robot Navigation System

Integer-Valued Training and Spike-Driven Inference Spiking Neural Network for High-performance and Energy-efficient Object Detection