Abstract:In the growing field of virtual auditory display, personalized head-related transfer functions (HRTFs) play a vital role in establishing an accurate sound image. In this work, we propose an HRTF personalization method employing convolutional neural networks (CNN) to predict a subject's HRTFs for all directions from their scanned head geometry. To ease the training of the CNN models, we propose novel pre-processing methods for both the head scans and HRTF data to achieve compact representations. For the head scan, we use truncated spherical cap harmonic (SCH) coefficients to represent the pinna area, which is important in the acoustic scattering process. For the HRTF data, we use truncated spherical harmonic (SH) coefficients to represent the HRTF magnitudes and onsets. One CNN model is trained to predict the SH coefficients of the HRTF magnitudes from the SCH coefficients of the scanned ear geometry and other anthropometric measurements of the head. The other CNN model is trained to predict SH coefficients of the HRTF onsets from only the anthropometric measurements of the ear, head, and torso. Combining the magnitude and onset predictions, our method is able to predict the complete and global HRTF data. A leave-one-out validation with the log-spectral distortion (LSD) metric is used for objective evaluation. The results show a decent LSD level at both spatial \& temporal dimensions compared to the ground-truth HRTFs and a lower LSD than the boundary element method (BEM) simulation of HRTFs that the database provides. The localization simulation results with an auditory model are also consistent with the objective evaluation metrics, showing the localization responses with our predicted HRTFs are significantly better than with the BEM calculated ones.

A pilot measurement of head-related transfer function blur in spatial localization

Distance-Dependent Head-Related Transfer Functions Measured with High Spatial Resolution Using a Spark Gap

Measurement and Analysis of Near-Field Head-Related Transfer Function

Identification of Anthropometric Measurements for Individualization of Head-Related Transfer Functions

Implementing Continuous HRTF Measurement in Near-Field

Numerical Modeling of Head-Related Transfer Functions Using the Virtual Source Representation

Distance-dependent Modeling of Head-related Transfer Functions

Effect of Sound Source Scattering on Measurement of Near-Field Head-Related Transfer Functions

Interpolation Method of Head-Related Transfer Functions Based on Common-Pole/zero Modeling

Head-Related Transfer Function Modeling Based on Finite-Impulse Response

HRTF Estimation in the Wild

Assessing the Potential Impact of Direction-Dependent HRTF Selection on Sound Localization Accuracy

A Sparse Spherical Harmonic-Based Model in Subbands for Head-Related Transfer Functions.

Distance localization using nonindividualized head‐related transfer functions

Magnitude-Corrected and Time-Aligned Interpolation of Head-Related Transfer Functions

Individualization Of Head-Related Transfer Function For Three-Dimensional Virtual Auditory Display: A Review

Comparison of headphones and equalization for virtual auditory source localization

Binaural sound source localization using a hybrid time and frequency domain model

Predicting Global Head-Related Transfer Functions From Scanned Head Geometry Using Deep Learning and Compact Representations

HRTF Field: Unifying Measured HRTF Magnitude Representation with Neural Fields

A Study of Morphological Influence on Head-Related Transfer Functions