Abstract:Dynamic parameterization of acoustic environments has drawn widespread attention in the field of audio processing. Precise representation of local room acoustic characteristics is crucial when designing audio filters for various audio rendering applications. Key parameters in this context include reverberation time (RT60) and geometric room volume. In recent years, neural networks have been extensively applied in the task of blind room parameter estimation. However, there remains a question of whether pure attention mechanisms can achieve superior performance in this task. To address this issue, this study employs blind room parameter estimation based on monaural noisy speech signals. Various model architectures are investigated, including a proposed attention-based model. This model is a convolution-free Audio Spectrogram Transformer, utilizing patch splitting, attention mechanisms, and cross-modality transfer learning from a pretrained Vision Transformer. Experimental results suggest that the proposed attention mechanism-based model, relying purely on attention mechanisms without using convolution, exhibits significantly improved performance across various room parameter estimation tasks, especially with the help of dedicated pretraining and data augmentation schemes. Additionally, the model demonstrates more advantageous adaptability and robustness when handling variable-length audio inputs compared to existing methods.

Hand-crafted Attention is All You Need? A Study of Attention on Self-supervised Audio Transformer.

Hand-crafted Attention is All You Need? A Study of Attention on Self-supervised Audio Transformer

Input-independent Attention Weights Are Expressive Enough: A Study of Attention in Self-supervised Audio Transformers

Understanding Self-Attention of Self-Supervised Audio Transformers

Probing self-attention in self-supervised speech models for cross-linguistic differences

When to Use Efficient Self Attention? Profiling Text, Speech and Image Transformer Variants

Adaptive Sparse and Monotonic Attention for Transformer-based Automatic Speech Recognition

Attention or Convolution: Transformer Encoders in Audio Language Models for Inference Efficiency

Selective Attention Improves Transformer

Is Attention All What You Need? -- An Empirical Investigation on Convolution-Based Active Memory and Self-Attention

Attention Is Not All You Need Anymore

Dual-Branch Attention-In-Attention Transformer for Single-Channel Speech Enhancement

Exploring the Power of Pure Attention Mechanisms in Blind Room Parameter Estimation

DARTFormer: Finding The Best Type Of Attention

Improving Transformers with Dynamically Composable Multi-Head Attention

Smart Bird: Learnable Sparse Attention for Efficient and Effective Transformer

An attention-based backend allowing efficient fine-tuning of transformer models for speaker verification

Superiority of Softmax: Unveiling the Performance Edge Over Linear Attention

SIMPLIFIED SELF-ATTENTION FOR TRANSFORMER-BASED END-TO-END SPEECH RECOGNITION

Relaxed Attention for Transformer Models

Enhancing Local Dependencies for Transformer-Based Text-to-Speech via Hybrid Lightweight Convolution