Abstract:In the growing field of virtual auditory display, personalized head-related transfer functions (HRTFs) play a vital role in establishing an accurate sound image. In this work, we propose an HRTF personalization method employing convolutional neural networks (CNN) to predict a subject's HRTFs for all directions from their scanned head geometry. To ease the training of the CNN models, we propose novel pre-processing methods for both the head scans and HRTF data to achieve compact representations. For the head scan, we use truncated spherical cap harmonic (SCH) coefficients to represent the pinna area, which is important in the acoustic scattering process. For the HRTF data, we use truncated spherical harmonic (SH) coefficients to represent the HRTF magnitudes and onsets. One CNN model is trained to predict the SH coefficients of the HRTF magnitudes from the SCH coefficients of the scanned ear geometry and other anthropometric measurements of the head. The other CNN model is trained to predict SH coefficients of the HRTF onsets from only the anthropometric measurements of the ear, head, and torso. Combining the magnitude and onset predictions, our method is able to predict the complete and global HRTF data. A leave-one-out validation with the log-spectral distortion (LSD) metric is used for objective evaluation. The results show a decent LSD level at both spatial \& temporal dimensions compared to the ground-truth HRTFs and a lower LSD than the boundary element method (BEM) simulation of HRTFs that the database provides. The localization simulation results with an auditory model are also consistent with the objective evaluation metrics, showing the localization responses with our predicted HRTFs are significantly better than with the BEM calculated ones.

Hrtf Representation With Convolutional Auto-Encoder

HRTF Field: Unifying Measured HRTF Magnitude Representation with Neural Fields

Interpolation Method of Head-Related Transfer Functions Based on Common-Pole/zero Modeling

An individualization approach for head-related transfer function in arbitrary directions based on deep learning

Efficient Representation Of Head-Related Transfer Functions With Combination Of Spherical Harmonics And Spherical Wavelets

Predicting Global Head-Related Transfer Functions From Scanned Head Geometry Using Deep Learning and Compact Representations

Modeling of Individual HRTFs Based on Spatial Principal Component Analysis.

Compression Of Head-Related Transfer Function Based On Tucker And Tensor Train Decomposition

Head-related transfer function (HRTF) synthesis based on a three-dimensional array model and singular value decomposition

A Time Domain Binaural Model Based on Spatial Feature Extraction for the Head-Related Transfer Function

Head-Related Transfer Function Modeling Based on Finite-Impulse Response

Numerical Modeling of Head-Related Transfer Functions Using the Virtual Source Representation

Tensor modeling and interpolation for distance-dependent head-related transfer function

A head-related transfer function model for fast synthesizing multiple virtual sound sources

Interpolation of Head-Related Transfer Functions Using Neural Network

Head-Related Transfer Function Interpolation with a Spherical CNN

Prediction of Head-Related Transfer Function Based on Tensor Completion

The decomposition and compression of HRTF based on adaptive fourier decomposition

Head Related Transfer Function Interpolation Based on Aligning Operation.

Distance-dependent Modeling of Head-related Transfer Functions

Median-Plane Head-Related Transfer Function Personalization Using Two-Dimensional Independent Component Analysis