The Cell Tracking Challenge: 10 Years of Objective Benchmarking
Martin Maska,Vladimir Ulman,Pablo Delgado-Rodriguez,Estibaliz Gomez-de-Mariscal,Tereza Necasova,Fidel A. Guerrero Pena,Tsang Ing Ren,Elliot M. Meyerowitz,Tim Scherr,Katharina Loeffler,Ralf Mikut,Tianqi Guo,Yin Wang,Jan P. Allebach,Rina Bao,Noor M. Al-Shakarji,Gani Rahmon,Imad Eddine Toubal,Kannappan Palaniappan,Filip Lux,Petr Matula,Ko Sugawara,Klas E. G. Magnusson,Layton Aho,Andrew R. Cohen,Assaf Arbelle,Tal Ben-Haim,Tammy Riklin Raviv,Fabian Isensee,Paul F. Jaeger,Klaus H. Maier-Hein,Yanming Zhu,Cristina Ederra,Ainhoa Urbiola,Erik Meijering,Alexandre Cunha,Arrate Munoz-Barrutia,Michal Kozubek,Carlos Ortiz-de-Solorzano
DOI: https://doi.org/10.1038/s41592-023-01879-y
IF: 48
2023-01-01
Nature Methods
Abstract:The Cell Tracking Challenge is an ongoing benchmarking initiative that has become a reference in cell segmentation and tracking algorithm development. Here, we present a significant number of improvements introduced in the challenge since our 2017 report. These include the creation of a new segmentation-only benchmark, the enrichment of the dataset repository with new datasets that increase its diversity and complexity, and the creation of a silver standard reference corpus based on the most competitive results, which will be of particular interest for data-hungry deep learning-based strategies. Furthermore, we present the up-to-date cell segmentation and tracking leaderboards, an in-depth analysis of the relationship between the performance of the state-of-the-art methods and the properties of the datasets and annotations, and two novel, insightful studies about the generalizability and the reusability of top-performing methods. These studies provide critical practical conclusions for both developers and users of traditional and machine learning-based cell segmentation and tracking algorithms. This updated analysis of the Cell Tracking Challenge explores how algorithms for cell segmentation and tracking in both 2D and 3D have advanced in recent years, pointing users to high-performing tools and developers to open challenges.