Abstract:Modern cars are equipped with both active and passive sensor systems that can detect potential collisions. In contrast, locusts avoid collisions solely by responding to certain visual cues that are associated with object looming. In neurophysiological experiments, I investigated the possibility that the 'collision-detector neurons' of locusts respond to impending collisions in films recorded with dashboard cameras of fast driving cars. In a complementary modelling approach, I developed a simple algorithm to reproduce the neuronal response that was recorded during object approach. Instead of applying elaborate algorithms that factored in object recognition and optic flow discrimination, I tested the hypothesis that motion detection restricted to a 'danger zone', in which frontal collisions on the motorways are most likely, is sufficient to estimate the risk of a collision. Furthermore, I investigated whether local motion vectors, obtained from the differential excitation of simulated direction-selective networks, could be used to predict evasive steering maneuvers and prevent undesired responses to motion artifacts. The results of the study demonstrate that the risk of impending collisions in real traffic scenes is mirrored in the excitation of the collision-detecting neuron (DCMD) of locusts. The modelling approach was able to reproduce this neuronal response even when the vehicle was driving at high speeds and image resolution was low (about 200 × 100 pixels). Furthermore, evasive maneuvers that involved changing the steering direction and steering force could be planned by comparing the differences in the overall excitation levels of the simulated right and left direction-selective networks. Additionally, it was possible to suppress undesired responses of the algorithm to translatory movements, camera shake and ground shadows by evaluating local motion vectors. These estimated collision risk values and evasive steering vectors could be used as input for a driving assistant, converting the first into braking force and the latter into steering responses to avoid collisions. Since many processing steps were computed on the level of pixels and involved elements of direction-selective networks, this algorithm can be implemented in hardware so that parallel computations enhance the processing speed significantly.

A fly inspired solution to looming detection for collision avoidance

A Robot Collision Avoidance Scheme Based on the Moving Obstacle Motion Prediction

Looming Detection in Complex Dynamic Visual Scenes by Interneuronal Coordination of Motion and Feature Pathways

Collision-Aware Navigation for Flapping-Wing Aerial Robots in Dense Environments

Modeling Drosophila vision neural pathways to detect weak moving targets from cluttered backgrounds

Flies as Ship Captains? Digital Evolution Unravels Selective Pressures to Avoid Collision in Drosophila

Moving object detection based on bioinspired background subtraction

Modeling bio-inspired visual neural for detecting visual features of small- and wide-field moving targets synchronously from complex dynamic environments

A Bio-inspired Collision Detecotr for Small Quadcopter

A Bio-inspired Collision Detector for Small Quadcopter

Enhancing LGMD's Looming Selectivity for UAV With Spatial-Temporal Distributed Presynaptic Connections

An autonomous robot inspired by insect neurophysiology pursues moving features in natural environments

Recent advances in insect vision in a 3D world: looming stimuli and escape behaviour

Modelling Drosophila motion vision pathways for decoding the direction of translating objects against cluttered moving backgrounds

Drosophila-Vision-Inspired Motion Perception Model and Its Application in Saliency Detection

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

A computationally efficient and robust looming perception model based on dynamic neural field

Aerodynamic imaging by mosquitoes inspires a surface detector for autonomous flying vehicles

FlyDetector—Automated Monitoring Platform for the Visual–Motor Coordination of Honeybees in a Dynamic Obstacle Scene Using Digital Paradigm

Analysis of collision avoidance in honeybee flight

Simplified bionic solutions: a simple bio-inspired vehicle collision detection system