Abstract:Transformer models have demonstrated superior performance across various domains, including computer vision , natural language processing , and speech recognition. The success of these models can be attributed to their robust parallel capacity and high computation speed, primarily reliant on the attention layer. In the domain of speaker recognition, state-of-the-art results have been achieved using convolutional neural network (CNN) architectures, particularly with speaker embeddings represented by x-vectors and r-vectors. However, existing CNN-based methods tend to focus on local features while overlooking the global dependence of voiceprint features, resulting in the loss of crucial information. Moreover, the presence of noise in audio data is an influential factor that cannot be disregarded, as it significantly impacts the extraction of discriminative speaker embeddings. To address these challenges, we propose a novel model called the Multi-Scale Expand Convolution Transformer (MEConformer). This model aims to convert variable-length audio into a fixed low-dimensional representation. The MEConformer leverages a CNN framework with expanded receptive fields to capture frame-level features effectively. Additionally, we introduce a transformer encoder that incorporates contextual dependencies, enabling the extraction of both frame-level and discourse-level feature representations. Furthermore, we present a multi-scale residual aggregation strategy, which facilitates the efficient transmission of voiceprint information across the model. By combining these innovative components, the MEConformer achieves a state-of-the-art Equal Error Rate (EER) of 3.72% on the VoxCeleb1 test set. Furthermore, it demonstrates EERs of 5.94% and 3.72% on the VoxCeleb1-H and VoxCeleb-E datasets, respectively. The code for the proposed MEConformer model will be made publicly available at https://codeocean.com/capsule/4563012/tree .

Conformer-based Language Embedding with Self-Knowledge Distillation for Spoken Language Identification

Leveraging ASR Pretrained Conformers for Speaker Verification through Transfer Learning and Knowledge Distillation

Self-Knowledge Distillation via Feature Enhancement for Speaker Verification

Mandarin Text-to-Speech Front-End with Lightweight Distilled Convolution Network

Attentive Temporal Pooling for Conformer-based Streaming Language Identification in Long-form Speech

Continual Learning for On-Device Speech Recognition using Disentangled Conformers

Pretraining Conformer with ASR or ASV for Anti-Spoofing Countermeasure

Deep temporal representation learning for language identification

Learning From Yourself: A Self-Distillation Method for Fake Speech Detection

SPformer: Hybrid Sequential-Parallel Architectures for Automatic Speech Recognition

Conformer-1: Robust ASR via Large-Scale Semisupervised Bootstrapping

MEConformer: Highly representative embedding extractor for speaker verification via incorporating selective convolution into deep speaker encoder

Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation

FusionFormer: Fusing Operations in Transformer for Efficient Streaming Speech Recognition

Fast Yet Effective Speech Emotion Recognition with Self-distillation

Efficient conformer-based speech recognition with linear attention

HM-Conformer: A Conformer-based audio deepfake detection system with hierarchical pooling and multi-level classification token aggregation methods

Introducing Multilingual Phonetic Information to Speaker Embedding for Speaker Verification

Transducer-based language embedding for spoken language identification

Enhance Language Identification using Dual-mode Model with Knowledge Distillation

Feature Learning and Ensemble Pre-Tasks Based Self-Supervised Speech Denoising and Dereverberation