Academic competitions

Hugo Jair Escalante,Aleksandra Kruchinina

2023-12-01

Abstract:Academic challenges comprise effective means for (i) advancing the state of the art, (ii) putting in the spotlight of a scientific community specific topics and problems, as well as (iii) closing the gap for under represented communities in terms of accessing and participating in the shaping of research fields. Competitions can be traced back for centuries and their achievements have had great influence in our modern world. Recently, they (re)gained popularity, with the overwhelming amounts of data that is being generated in different domains, as well as the need of pushing the barriers of existing methods, and available tools to handle such data. This chapter provides a survey of academic challenges in the context of machine learning and related fields. We review the most influential competitions in the last few years and analyze challenges per area of knowledge. The aims of scientific challenges, their goals, major achievements and expectations for the next few years are reviewed.

Machine Learning,Artificial Intelligence

What problem does this paper attempt to address?

The problems that this paper attempts to solve are the current situation, influence and future development directions of academic competitions in machine learning and related fields. Specifically, the paper aims to:

1. **Review the history**: Provide a historical review of academic competitions, especially those in machine learning and related fields, from early competitions such as RoboCup, TREC, ICDAR, KDD Cup, etc., to recent AutoML challenges, ImageNet Large - Scale Visual Recognition Challenge, etc., and analyze the influence and development of these competitions on their respective fields.

2. **Analyze the influence**: Evaluate the positive roles of academic competitions in promoting scientific research, facilitating technological progress, establishing benchmark tests, and improving data availability. At the same time, it also discusses the possible negative impacts of competitions, such as the contradiction between performance optimization and scientific contributions, data leakage, privacy protection and other issues.

3. **Look into the future**: Explore the development directions of future academic competitions, including how to design more scientifically rigorous competitions, how to reward innovative and novel solutions, how to disseminate competition results through publications and top - level conferences, and how to attract more participants to join the competitions.

Through the analysis of these aspects, the paper hopes to provide readers with a comprehensive perspective on the role of academic competitions in machine learning and related fields, and provide guidance and suggestions for future competition organizers and participants.