Abstract:Apparent motion of the surroundings on an agent's retina can be used to navigate through cluttered environments, avoid collisions with obstacles, or track targets of interest. The pattern of apparent motion of objects, (i.e., the optic flow), contains spatial information about the surrounding environment. For a small, fast-moving agent, as used in search and rescue missions, it is crucial to estimate the distance to close-by objects to avoid collisions quickly. This estimation cannot be done by conventional methods, such as frame-based optic flow estimation, given the size, power, and latency constraints of the necessary hardware. A practical alternative makes use of event-based vision sensors. Contrary to the frame-based approach, they produce so-called events only when there are changes in the visual scene. We propose a novel asynchronous circuit, the spiking elementary motion detector (sEMD), composed of a single silicon neuron and synapse, to detect elementary motion from an event-based vision sensor. The sEMD encodes the time an object's image needs to travel across the retina into a burst of spikes. The number of spikes within the burst is proportional to the speed of events across the retina. A fast but imprecise estimate of the time-to-travel can already be obtained from the first two spikes of a burst and refined by subsequent interspike intervals. The latter encoding scheme is possible due to an adaptive nonlinear synaptic efficacy scaling. We show that the sEMD can be used to compute a collision avoidance direction in the context of robotic navigation in a cluttered outdoor environment and compared the collision avoidance direction to a frame-based algorithm. The proposed computational principle constitutes a generic spiking temporal correlation detector that can be applied to other sensory modalities (e.g., sound localization), and it provides a novel perspective to gating information in spiking neural networks.

Motion Detecting Two-Dimensional Three-Layers Analog Electronic Circuits Using Biomedical Vision Model

Distance measuring modeling and error analysis of dual-CCD vision system simulating human eyes and neck

An Elementary-Motion-Detector Based on Hardware Lateral Inhibition Network

High Dynamic-Range Motion Imaging Based on Linearized Doppler Radar Sensor

Non-contact Detection of Doppler Bio-Signals Based on Gradient Decent and Extended DACM Algorithms

Doppler Radar Noncontact Imaging of Human Cardiac Motion

A Relative Motion Model for Myocardial Infarction Detection

All-in-one two-dimensional retinomorphic hardware device for motion detection and recognition

Evaluation of deep learning models in contactless human motion detection system for next generation healthcare

A Cell Model for the Detection of a Planar Surface Using Motion Stereo in Area MST of the Visual Cortex

A self-powered 2-dimensional motion detection chip

Wireless magnetic motion capture system for medical use

A learning artificial visual system for motion direction detection

An Intelligent Signal Processing Method for Motional Vital Signs Detection System Based on Deep Learning

Retinomorphic Motion Detector Fabricated with Organic Infrared Semiconductors

Analog-Hall-Sensor-Based Position Detection Method With Temperature Compensation For Permanent-Magnet Linear Motor

Neuromorphic analog VLSI sensor for visual tracking: circuits and application examples

Fully Memristive Elementary Motion Detectors for A Maneuver Prediction

A saliency based motion detection model of visual system considering visual adaptation properties

Artificial Visual Network with Fully Modeled Retinal Direction-Selective Neural Pathway for Motion Direction Detection in Grayscale Scenes

Spiking Elementary Motion Detector in Neuromorphic Systems