Abstract:In this paper, we present a novel approach referred to as the audio-based virtual landmark-based HoloSLAM. This innovative method leverages a single sound source and microphone arrays to estimate the voice-printed speaker's direction. The system allows an autonomous robot equipped with a single microphone array to navigate within indoor environments, interact with specific sound sources, and simultaneously determine its own location while mapping the environment. The proposed method does not require multiple audio sources in the environment nor sensor fusion to extract pertinent information and make accurate sound source estimations. Furthermore, the approach incorporates Robotic Mixed Reality using Microsoft HoloLens to superimpose landmarks, effectively mitigating the audio landmark-related issues of conventional audio-based landmark SLAM, particularly in situations where audio landmarks cannot be discerned, are limited in number, or are completely missing. The paper also evaluates an active speaker detection method, demonstrating its ability to achieve high accuracy in scenarios where audio data are the sole input. Real-time experiments validate the effectiveness of this method, emphasizing its precision and comprehensive mapping capabilities. The results of these experiments showcase the accuracy and efficiency of the proposed system, surpassing the constraints associated with traditional audio-based SLAM techniques, ultimately leading to a more detailed and precise mapping of the robot's surroundings.

Detecting and Classifying Bio-Inspired Artificial Landmarks Using In-Air 3D Sonar

Semantic Landmark Detection & Classification Using Neural Networks For 3D In-Air Sonar

Robust Mobile Robot Localization By Fusing Laser And Sonar

Recognising landmarks with ultrasonic sensing for autonomous mobile robot navigation

Landmark recognition system for mini rotor aerial robot

Robust Inertial-aided Underwater Localization and Navigation based on Imaging Sonar Keyframes

A Biologically-Inspired Simultaneous Localization and Mapping System Based on LiDAR Sensor

Combining Deep Learning and Model-Based Methods for Robust Real-Time Semantic Landmark Detection

Landmark Management in the Application of Radar SLAM

Radar-based Automotive Localization using Landmarks in a Multimodal Sensor Graph-based Approach

Underwater Slam Algorithm Based on Image Sonar Salient Target Detection

Artificial Landmark Design and Detection Using Hierarchy Information for UAV Localization and Landing

Automatic target recognition and geo-location for side scan sonar imagery

Opti-Acoustic Semantic SLAM with Unknown Objects in Underwater Environments

SBC-SLAM: Semantic Bioinspired Collaborative SLAM for Large-Scale Environment Perception of Heterogeneous Systems

AI Based Landscape Sensing Using Radio Signals

Real-Time Sonar Image Simulation for Adaptive Template Matching in Automatic Target Recognition

Experimental Research on Feature Extraction of Laser SLAM Based on Artificial Landmarks

Visual-Based Semantic SLAM with Landmarks for Large-Scale Outdoor Environment

An Audio-Based SLAM for Indoor Environments: A Robotic Mixed Reality Presentation

A machine vision meta-algorithm for automated recognition of underwater objects using sidescan sonar imagery