Abstract:Physiological studies have shown that a group of locust's lobula giant movement detectors (LGMDs) has a diversity of collision selectivity to approaching objects, relatively darker or brighter than their backgrounds in cluttered environments. Such diversity of collision selectivity can serve locusts to escape from attack by natural enemies, and migrate in swarm free of collision. For computational studies, endeavours have been made to realize the diverse selectivity which, however, is still one of the most challenging tasks especially in complex and dynamic real world scenarios. The existing models are mainly formulated as multi-layered neural networks with merely feed-forward information processing, and do not take into account the effect of re-entrant signals in feedback loop, which is an essential regulatory loop for motion perception, yet never been explored in looming perception. In this paper, we inaugurate feedback neural computation for constructing a new LGMD-based model, named F-LGMD to look into the efficacy upon implementing different collision selectivity. Accordingly, the proposed neural network model features both feed-forward processing and feedback loop. The feedback control propagates output signals of parallel ON/OFF channels back into their starting neurons, thus makes part of the feed-forward neural network, i.e. the ON/OFF channels and the feedback loop form an iterative cycle system. Moreover, the feedback control is instantaneous, which leads to the existence of a fixed point whereby the fixed point theorem is applied to rigorously derive valid range of feedback coefficients. To verify the effectiveness of the proposed method, we conduct systematic experiments covering synthetic and natural collision datasets, and also online robotic tests. The experimental results show that the F-LGMD, with a unified network, can fulfil the diverse collision selectivity revealed in physiology, which not only reduces considerably the handcrafted parameters compared to previous studies, but also offers a both efficient and robust scheme for collision perception through feedback neural computation.

O-LGMD: An Opponent Colour LGMD-Based Model for Collision Detection with Thermal Images at Night.

Temperature-based Collision Detection in Extreme Low Light Condition with Bio-inspired LGMD Neural Network

Collision Selective Visual Neural Network Inspired by LGMD2 Neurons in Juvenile Locusts

Robustness of Bio-Inspired Visual Systems for Collision Prediction in Critical Robot Traffic

Enhancing LGMD-based model for collision prediction via binocular structure

A Visual Neural Network for Robust Collision Perception in Vehicle Driving Scenarios

LGMD and DSNs Neural Networks Integration for Collision Predication.

A Bio-Inspired Probabilistic Neural Network Model for Noise-Resistant Collision Perception

An insect vision-inspired neuromorphic vision systems in low-light obstacle avoidance for intelligent vehicles

A directionally selective collision-sensing visual neural network based on fractional-order differential operator

A Biomimetic Visual Detection Model: Event-Driven LGMDs Implemented With Fractional Spiking Neuron Circuits

Bioinspired approach-sensitive neural network for collision detection in cluttered and dynamic backgrounds

Multiclass objects detection algorithm using DarkNet-53 and DenseNet for intelligent vehicles

A Deep Thermal-Guided Approach for Effective Low-Light Visible Image Enhancement.

Bio-Inspired Dark Adaptive Nighttime Object Detection

Competition between ON and OPP Neural Pathways Enhancing Collision Selectivity

LFIR-YOLO: Lightweight Model for Infrared Vehicle and Pedestrian Detection

A look into feedback neural computation upon collision selectivity

Robust Environment Perception for Automated Driving: A Unified Learning Pipeline for Visual-Infrared Object Detection

Competition between ON and OFF Neural Pathways Enhancing Collision Selectivity.

Multi-Color Vehicle Tracking Based on Lightweight Neural Network