Abstract:Apparent motion of the surroundings on an agent's retina can be used to navigate through cluttered environments, avoid collisions with obstacles, or track targets of interest. The pattern of apparent motion of objects, (i.e., the optic flow), contains spatial information about the surrounding environment. For a small, fast-moving agent, as used in search and rescue missions, it is crucial to estimate the distance to close-by objects to avoid collisions quickly. This estimation cannot be done by conventional methods, such as frame-based optic flow estimation, given the size, power, and latency constraints of the necessary hardware. A practical alternative makes use of event-based vision sensors. Contrary to the frame-based approach, they produce so-called events only when there are changes in the visual scene. We propose a novel asynchronous circuit, the spiking elementary motion detector (sEMD), composed of a single silicon neuron and synapse, to detect elementary motion from an event-based vision sensor. The sEMD encodes the time an object's image needs to travel across the retina into a burst of spikes. The number of spikes within the burst is proportional to the speed of events across the retina. A fast but imprecise estimate of the time-to-travel can already be obtained from the first two spikes of a burst and refined by subsequent interspike intervals. The latter encoding scheme is possible due to an adaptive nonlinear synaptic efficacy scaling. We show that the sEMD can be used to compute a collision avoidance direction in the context of robotic navigation in a cluttered outdoor environment and compared the collision avoidance direction to a frame-based algorithm. The proposed computational principle constitutes a generic spiking temporal correlation detector that can be applied to other sensory modalities (e.g., sound localization), and it provides a novel perspective to gating information in spiking neural networks.

Exploiting the PIR Sensor Analog Behavior as Thermoreceptor: Movement Direction Classification Based on Spiking Neurons

Multi-Target PIR Indoor Localization and Tracking System with Artificial Intelligence

Detection of human body motion features using pyroelectric infrared sensor

Cooperative Networked PIR Detection System for Indoor Human Localization

Pyroelectric infrared sensor for intruder detection

A new PIR-based method for real-time tracking

Spiking Elementary Motion Detector in Neuromorphic Systems

Insect-Inspired Elementary Motion Detection Embracing Resistive Memory and Spiking Neural Networks

Feedforward Categorization on AER Motion Events Using Cortex-Like Features in a Spiking Neural Network

Discrimination of Human Motor Patterns by Pyroelectric Infrared Signals

Multiframe-integrated, In-Sensor Computing Using Persistent Photoconductivity

Animation and Chirplet-Based Development of a PIR Sensor Array for Intruder Classification in an Outdoor Environment

Bioinspired Artificial Infrared Neural System Based on Single-Crystal Thin Films for Spatiotemporal Fusion Imaging

Preprocessing Design in Pyroelectric Infrared Sensor-Based Human-Tracking System: On Sensor Selection and Calibration

Low-Power Perovskite Neuromorphic Synapse with Enhanced Photon Efficiency for Directional Motion Perception

An Artificial Spiking Afferent Nerve Based on Synaptic Transistor for Thermal Perception

Human movement counter using pyroelectric infrared detectors

An Oxide Based Spiking Thermoreceptor for Low-Power Thermography Edge Detection

Optoelectronic graded neurons for bioinspired in-sensor motion perception

Credit-Based Multiple Human Location for Passive Binary Pyroelectric Infrared Sensor Tracking System: Free From Region Partition and Classifier

Use of multi-frequency ultrasonic sensors with PIR sensors to enhance the sensing probability of an embedded surveillance system