Abstract:This paper presents an estimation of the sound source location using deep neural networks in order to provide auditory perception of a humanoid robot. Estimation of a moving sound source is crucial for a humanoid robot to improve functionality in some environments where the robot’s camera cannot operate. It plays an important role, especially in a recovery scenario with no visual contact. In this study, the data of the sound source around the robot were recorded by four microphones placed on the humanoid robot’s head. A wheeled robot was used to obtain the sound source with odometry. Recorded sound dataset and collected odometry dataset were used as input data and target data, respectively. The discrete wavelet transform (DWT) was applied for pre-processing of the input data. After pre-processing, the obtained matrices were applied as inputs of the proposed convolutional neural network (CNN), long short-term memory (LSTM), bidirectional long-short-term memory (biLSTM), and multilayer perceptron (MLP) networks to estimate the sound source location around the humanoid robot. As a result of all tests for the estimation models created by proposed networks, the R2documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$R^2$$end{document} metrics of the biLSTM structure were obtained as approximately 0.97. This study showed experimentally that humanoid robots can sense the position of sound source in the environment with sufficient accuracy like many living creatures.

Sound source localization for robotics by binaural methods

Sound Source Localization Method Based on Binaural Model Paper Title

A survey of sound source localization for robot audition

Sound source localization for auditory perception of a humanoid robot using deep neural networks

Efficient and Robust Approaches for Three-Dimensional Sound Source Recognition and Localization Using Humanoid Robots Sensor Arrays

A Spatial Sound Localization System for Mobile Robots

A Sound Source Localization Method Based on Microphone Array for Mobile Robot

Sound Source Localization for Mobile Robot Based on Time Difference Feature and Space Grid Matching.

Binaural sound source localization based on generalized parametric model and two-layer matching strategy in complex environments

A new hierarchical binaural sound source localization method based on Interaural Matching Filter

Binaural Cues Estimates Based on Interaural Matching Filter for Sound Source Localization.

Binaural sound source localization using a hybrid time and frequency domain model

HRTF-based Localization and Separation of Multiple Sound Sources

Binaural sound localization based on time-delay compensation and spatial grid matching

Position Identification by Actively Localizing Spacial Sound Beacons.

Spatial Localization of Concurrent Multiple Sound Sources Using Phase Candidate Histogram

Sound source localization based on binaural cross-correlation functions

A two-layer probabilistic model based on time-delay compensation for binaural sound localization

Cross-correlation function based two-sensor auditory localization unit for chat robots

Combined 2-D sound source localization with stereo vision for intelligent Human-Robot Interaction of service robot

Robot Navigation and Sound Based Position Identification