Abstract:Apparent motion of the surroundings on an agent's retina can be used to navigate through cluttered environments, avoid collisions with obstacles, or track targets of interest. The pattern of apparent motion of objects, (i.e., the optic flow), contains spatial information about the surrounding environment. For a small, fast-moving agent, as used in search and rescue missions, it is crucial to estimate the distance to close-by objects to avoid collisions quickly. This estimation cannot be done by conventional methods, such as frame-based optic flow estimation, given the size, power, and latency constraints of the necessary hardware. A practical alternative makes use of event-based vision sensors. Contrary to the frame-based approach, they produce so-called events only when there are changes in the visual scene. We propose a novel asynchronous circuit, the spiking elementary motion detector (sEMD), composed of a single silicon neuron and synapse, to detect elementary motion from an event-based vision sensor. The sEMD encodes the time an object's image needs to travel across the retina into a burst of spikes. The number of spikes within the burst is proportional to the speed of events across the retina. A fast but imprecise estimate of the time-to-travel can already be obtained from the first two spikes of a burst and refined by subsequent interspike intervals. The latter encoding scheme is possible due to an adaptive nonlinear synaptic efficacy scaling. We show that the sEMD can be used to compute a collision avoidance direction in the context of robotic navigation in a cluttered outdoor environment and compared the collision avoidance direction to a frame-based algorithm. The proposed computational principle constitutes a generic spiking temporal correlation detector that can be applied to other sensory modalities (e.g., sound localization), and it provides a novel perspective to gating information in spiking neural networks.

Fully Memristive Elementary Motion Detectors for A Maneuver Prediction

Insect-Inspired Elementary Motion Detection Embracing Resistive Memory and Spiking Neural Networks

Memristor-based Biomimetic Compound Eye for Real-Time Collision Detection

A Memristor-Based Bipolar Cell Neuron Circuit for Motion Detection and Action Prediction

Neuromorphic Extreme Learning Machines with Bimodal Memristive Synapses

A Gate-Tunable Memristor Emulator for Motion Detection

Artificial Neural Pathway Based on a Memristor Synapse for Optically Mediated Motion Learning

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

A Multifunctional and Efficient Artificial Visual Perception Nervous System with Sb2Se3/CdS‐Core/Shell (SC) Nanorod Arrays Optoelectronic Memristor

Spiking Elementary Motion Detector in Neuromorphic Systems

A Braitenberg Vehicle Based on Memristive Neuromorphic Circuits

Computing Motion with 3D Memristive Grid

Dynamic neural network with memristive CIM and CAM for 2D and 3D vision

Memristive Extreme Learning Machine: A Neuromorphic Implementation

Anticipative Objective Tracking with Short-Term Memristive Synapses

An Intelligent Reinforcement Actuating Sensing Learning System Based on the Neuromorphic-Induced Electrodynamics Model

Dynamics of Dual Memristors-based Neuron Circuit for Pattern Recognition

A Biomimetic Model of the Outer Plexiform Layer by Incorporating Memristive Devices

Memristor-based adaptive neuromorphic perception in unstructured environments

Dynamic machine vision with retinomorphic photomemristor-reservoir computing

FPGA Design and Implementation of Insect-inspired Reichardt Motion Detector and Receptive Field