Abstract:The ability of certain bat species to navigate in dense vegetation based on trains of short biosonar echoes could provide for an alternative parsimonious approach to obtaining the sensory information that is needed to achieve autonomy in complex natural environments. Although bat biosonar has much lower data rates and spatial (angular) resolution than commonly used human-made sensing systems such as LiDAR or stereo cameras, bat species that live in dense habitats have the ability to reliably detect narrow passageways in foliage. To study the sensory information that the animals may have available to accomplish this, we have used a biomimetic sonar system that was combined with a camera to record echoes and synchronized images from 10 different field sites that featured narrow passageways in foliage. The synchronized camera and sonar data allowed us to create a large data set (130 000 samples) of labeled echoes using a teacher-student approach that used class labels derived from the images to provide training data for echo-based classifiers. The performance achieved in detecting passageways based on the field data closely matched previous results obtained for gaps in an artificial foliage setup in the laboratory. With a deep feature extraction neural network (VGG16) a foliage-versus-passageway classification accuracy of 96.64% was obtained. A transparent artificial intelligence approach (class-activation mapping) indicated that the classifier network relied heavily on the initial rising flank of the echoes. This finding could be exploited with a neuromorphic echo representation that consisted of times where the echo envelope crossed a certain amplitude threshold in a given frequency channel. Whereas a single amplitude threshold was sufficient for this in the previous laboratory study, multiple thresholds were needed to achieve an accuracy of 92.23%. These findings indicate that despite many sources of variability that shape clutter echoes from natural environments, these signals contain sufficient sensory information to enable the detection of passageways in foliage.

A bat biomimetic model for scenario recognition using echo Doppler information

Bionic study of distance-azimuth discrimination of multi-scattered point objects in bat bio-sonar

Detection of passageways in natural foliage using biomimetic sonar

Discrimination of object information by bat echolocation deciphered from acoustic simulations

Machine learning methods for reconstructing the acoustic fields of bat biosonar

BatVision: Learning to See 3D Spatial Layout with Two Ears

Ultrasonic Spatial Target Localization Using Artificial Pinnae of Brown Long-eared Bat

Bat2Web: A Framework for Real-Time Classification of Bat Species Echolocation Signals Using Audio Sensor Data

A Neural Mechanism for Detecting the Distance of a Selected Target by Modulating the FM Sweep Rate of Biosonar in Echolocation of Bat

Dynamic periphery in a biomimetic sonar system introduces time-variant signatures into targets echoes

A Portable Terminal for Acoustic Monitoring and Online Recognition of Bats with CNN-LSTM

Action Enhances Acoustic Cues for 3-D Target Localization by Echolocating Bats

Dynamic control of the acoustic scene in echolocating bats

Echolocation of insects using intermittent frequency-modulated sounds

Accurate Target Localization by using Artificial Pinnae of brown long-eared bat

Binaural Localization Simulation of a Imitation Bat for the Ultrasonic Detection

Active Listening for Spatial Orientation in a Complex Auditory Scene

Tight coordination of aerial flight maneuvers and sonar call production in insectivorous bats

Perceiving like a Bat: Hierarchical 3D Geometric-Semantic Scene Understanding Inspired by a Biomimetic Mechanism

Echo-acoustic scanning with noseleaf and ears in phyllostomid bats

Decoding Target Range from Sensori-motor Neuron Activities in Echolocating Bat Superior Colliculus