Text-dependent Speaker Verification (TdSV) Challenge 2024: Challenge Evaluation Plan

Zeinali Hossein,Lee Kong Aik,Alam Jahangir,Burget Lukas

2024-04-21

Abstract:This document outlines the Text-dependent Speaker Verification (TdSV) Challenge 2024, which centers on analyzing and exploring novel approaches for text-dependent speaker verification. The primary goal of this challenge is to motive participants to develop single yet competitive systems, conduct thorough analyses, and explore innovative concepts such as multi-task learning, self-supervised learning, few-shot learning, and others, for text-dependent speaker verification.

Sound,Artificial Intelligence,Audio and Speech Processing

What problem does this paper attempt to address?

This paper describes the evaluation plan for the 2024 Text-dependent Speaker Verification (TdSV) Challenge. The core goal of the challenge is to encourage researchers to develop innovative methods for addressing text-dependent speaker verification problems, including techniques such as multi-task learning, self-supervised learning, and few-shot learning. The competition consists of two tasks:

Task 1: Traditional text-dependent speaker verification, where the system needs to identify whether a specific phrase is spoken by the target speaker, considering both the content of the phrase and the speaker.

Task 2: Speaker verification using user-defined passphrases, where the system needs to determine whether the speaker correctly utters the test speech without knowing the passphrase content.

The challenge uses the second version of the DeepMine dataset, which includes training and evaluation data for both tasks, as well as specified training, enrollment, and testing conditions. The evaluation metrics primarily include the normalized minimum detection cost function (DCF) and the equal error rate (EER). Additionally, the paper provides detailed explanations of data organization, model registration file and trial file formats, as well as requirements for result submission and evaluation protocols.

Participants are required to comply with the rules, such as using the specified training data, independently handling each experiment, and not probing or manually processing the test data. The challenge offers cash prizes and encourages the submission of system descriptions for further research. Lastly, the paper provides the schedule for the challenge and relevant resource links.