Abstract:Similar to most visual animals, the crab Neohelice granulata relies predominantly on visual information to escape from predators, to track prey and for selecting mates. It, therefore, needs specialized neurons to process visual information and determine the spatial location of looming objects. In the crab Neohelice granulata, the Monostratified Lobula Giant type1 (MLG1) neurons have been found to manifest looming sensitivity with finely tuned capabilities of encoding spatial location information. MLG1s neuronal ensemble can not only perceive the location of a looming stimulus, but are also thought to be able to influence the direction of movement continuously, for example, escaping from a threatening, looming target in relation to its position. Such specific characteristics make the MLG1s unique compared to normal looming detection neurons in invertebrates which can not localize spatial looming. Modeling the MLG1s ensemble is not only critical for elucidating the mechanisms underlying the functionality of such neural circuits, but also important for developing new autonomous, efficient, directionally reactive collision avoidance systems for robots and vehicles. However, little computational modeling has been done for implementing looming spatial localization analogous to the specific functionality of MLG1s ensemble. To bridge this gap, we propose a model of MLG1s and their pre-synaptic visual neural network to detect the spatial location of looming objects. The model consists of 16 homogeneous sectors arranged in a circular field inspired by the natural arrangement of 16 MLG1s' receptive fields to encode and convey spatial information concerning looming objects with dynamic expanding edges in different locations of the visual field. Responses of the proposed model to systematic real-world visual stimuli match many of the biological characteristics of MLG1 neurons. The systematic experiments demonstrate that our proposed MLG1s model works effectively and robustly to perceive and localize looming information, which could be a promising candidate for intelligent machines interacting within dynamic environments free of collision. This study also sheds light upon a new type of neuromorphic visual sensor strategy that can extract looming objects with locational information in a quick and reliable manner.

A look into the cockpit of the developing locust: Looming detectors and predator avoidance

Escapes with and without preparation: the neuroethology of visual startle in locusts

Motion detectors in the locust visual system: From biology to robot sensors

Background optic flow modulates responses of multiple descending interneurons to object motion in locusts

Bilateral flight muscle activity predicts wing kinematics and 3-dimensional body orientation of locusts responding to looming objects

Complex motion trajectories are represented by a population code from the ensemble activity of multiple motion-sensitive descending interneurons in locusts

A neural model of the locust visual system for detection of object approaches with real-world scenes

OppLoD: the Opponency based Looming Detector, Model Extension of Looming Sensitivity from LGMD to LPLC2

A Visual Pathway for Looming-Evoked Escape in Larval Zebrafish

Interaction of compass sensing and object-motion detection in the locust central complex

Olfactory system structure and function in newly hatched and adult locusts

Recent advances in insect vision in a 3D world: looming stimuli and escape behaviour

Collision Selective Visual Neural Network Inspired by LGMD2 Neurons in Juvenile Locusts

A Looming Spatial Localization Neural Network Inspired by MLG1 Neurons in the Crab Neohelice

Competition between ON and OFF Neural Pathways Enhancing Collision Selectivity.

Developmental changes in the structure and function of the central olfactory system in gregarious and solitary desert locusts

Neuronal ON/OFF Motion Detection Circuits Underlying Looming-Evoked Escape Behavior in Drosophila

Enhancing LGMD's Looming Selectivity for UAV With Spatial-Temporal Distributed Presynaptic Connections

Competition between ON and OPP Neural Pathways Enhancing Collision Selectivity

Central projections from Johnston's organ in the locust: Axogenesis and brain neuroarchitecture

Looming Detection in Complex Dynamic Visual Scenes by Interneuronal Coordination of Motion and Feature Pathways