Abstract:The US National Institute of Standards and Technology (NIST) has been conducting a second iteration of the CTS challenge since August 2020. The current iteration of the CTS Challenge is a leaderboard-style speaker recognition evaluation using telephony data extracted from the unexposed portions of the Call My Net 2 (CMN2) and Multi-Language Speech (MLS) corpora collected by the LDC. The CTS Challenge is currently organized in a similar manner to the SRE19 CTS Challenge, offering only an open training condition using two evaluation subsets, namely Progress and Test. Unlike in the SRE19 Challenge, no training or development set was initially released, and NIST has publicly released the leaderboards on both subsets for the CTS Challenge. Which subset (i.e., Progress or Test) a trial belongs to is unknown to challenge participants, and each system submission needs to contain outputs for all of the trials. The CTS Challenge has also served, and will continue to do so, as a prerequisite for entrance to the regular SREs (such as SRE21). Since August 2020, a total of 53 organizations (forming 33 teams) from academia and industry have participated in the CTS Challenge and submitted more than 4400 valid system outputs. This paper presents an overview of the evaluation and several analyses of system performance for some primary conditions in the CTS Challenge. The CTS Challenge results thus far indicate remarkable improvements in performance due to 1) speaker embeddings extracted using large-scale and complex neural network architectures such as ResNets along with angular margin losses for speaker embedding extraction, 2) extensive data augmentation, 3) the use of large amounts of in-house proprietary data from a large number of labeled speakers, 4) long-duration fine-tuning.

I4U System Description for NIST SRE'20 CTS Challenge

I4U Submission for the 2008 NIST Speaker Recognition Evaluation Submission

The 14u System In Nist 2008 Speaker Recognition Evaluation

THUEE system description for NIST 2020 SRE CTS challenge

The NIST CTS Speaker Recognition Challenge

THUEE System for NIST SRE19 CTS Challenge.

HLT-NUS Submission for NIST 2019 Multimedia Speaker Recognition Evaluation

The USTC-NERCSLIP Systems for the CHiME-8 NOTSOFAR-1 Challenge

THUEE system description for NIST 2019 SRE CTS Challenge

STC speaker recognition systems for the NIST SRE 2021

UTD-CRSS Systems for 2016 NIST Speaker Recognition Evaluation

UIAI System for Short-Duration Speaker Verification Challenge 2020

The Sjtu System for Multimodal Information Based Speech Processing Challenge 2021

The SpeakIn System Description for CNSRC2022

The USTC-NERCSLIP Systems for The ICMC-ASR Challenge

The MIT-LL, JHU and LRDE NIST 2016 Speaker Recognition Evaluation System

THU-EE System Description for NIST LRE 2015

The Intelligent Voice 2016 Speaker Recognition System

The NUS-HLT System for ICASSP2024 ICMC-ASR Grand Challenge

Ifly System for the NIST 2008 Speaker Recognition Evaluation