Abstract:Physiological studies have shown that a group of locust's lobula giant movement detectors (LGMDs) has a diversity of collision selectivity to approaching objects, relatively darker or brighter than their backgrounds in cluttered environments. Such diversity of collision selectivity can serve locusts to escape from attack by natural enemies, and migrate in swarm free of collision. For computational studies, endeavours have been made to realize the diverse selectivity which, however, is still one of the most challenging tasks especially in complex and dynamic real world scenarios. The existing models are mainly formulated as multi-layered neural networks with merely feed-forward information processing, and do not take into account the effect of re-entrant signals in feedback loop, which is an essential regulatory loop for motion perception, yet never been explored in looming perception. In this paper, we inaugurate feedback neural computation for constructing a new LGMD-based model, named F-LGMD to look into the efficacy upon implementing different collision selectivity. Accordingly, the proposed neural network model features both feed-forward processing and feedback loop. The feedback control propagates output signals of parallel ON/OFF channels back into their starting neurons, thus makes part of the feed-forward neural network, i.e. the ON/OFF channels and the feedback loop form an iterative cycle system. Moreover, the feedback control is instantaneous, which leads to the existence of a fixed point whereby the fixed point theorem is applied to rigorously derive valid range of feedback coefficients. To verify the effectiveness of the proposed method, we conduct systematic experiments covering synthetic and natural collision datasets, and also online robotic tests. The experimental results show that the F-LGMD, with a unified network, can fulfil the diverse collision selectivity revealed in physiology, which not only reduces considerably the handcrafted parameters compared to previous studies, but also offers a both efficient and robust scheme for collision perception through feedback neural computation.

LGMD and DSNs Neural Networks Integration for Collision Predication.

Collision Selective Visual Neural Network Inspired by LGMD2 Neurons in Juvenile Locusts

A Visual Neural Network for Robust Collision Perception in Vehicle Driving Scenarios

Robustness of Bio-Inspired Visual Systems for Collision Prediction in Critical Robot Traffic

A Multiple Vehicle Sensing Approach for Collision Avoidance in Progressively Deployed Vehicle Networks.

Enhancing LGMD-based model for collision prediction via binocular structure

A directionally selective collision-sensing visual neural network based on fractional-order differential operator

Collaborative Recognition of Feasible Region with Aerial and Ground Robots Through DPCN

A Bio-Inspired Probabilistic Neural Network Model for Noise-Resistant Collision Perception

O-LGMD: An Opponent Colour LGMD-Based Model for Collision Detection with Thermal Images at Night.

An insect vision-inspired neuromorphic vision systems in low-light obstacle avoidance for intelligent vehicles

A Biomimetic Visual Detection Model: Event-Driven LGMDs Implemented With Fractional Spiking Neuron Circuits

Temperature-based Collision Detection in Extreme Low Light Condition with Bio-inspired LGMD Neural Network

Bioinspired approach-sensitive neural network for collision detection in cluttered and dynamic backgrounds

An LGMD Based Competitive Collision Avoidance Strategy for UAV

A look into feedback neural computation upon collision selectivity

Sequential Spatial Network for Collision Avoidance in Autonomous Driving

A Real-Time Collision Prediction Mechanism With Deep Learning for Intelligent Transportation System

A neural model of the locust visual system for detection of object approaches with real-world scenes

A system of vision sensor based deep neural networks for complex driving scene analysis in support of crash risk assessment and prevention

A robust collision prediction and detection method based on neural network for autonomous delivery robots