Towards Real-Time Analysis of Broadcast Badminton Videos

Nitin Nilesh,Tushar Sharma,Anurag Ghosh,C. V. Jawahar

2023-08-23

Abstract:Analysis of player movements is a crucial subset of sports analysis. Existing player movement analysis methods use recorded videos after the match is over. In this work, we propose an end-to-end framework for player movement analysis for badminton matches on live broadcast match videos. We only use the visual inputs from the match and, unlike other approaches which use multi-modal sensor data, our approach uses only visual cues. We propose a method to calculate the on-court distance covered by both the players from the video feed of a live broadcast badminton match. To perform this analysis, we focus on the gameplay by removing replays and other redundant parts of the broadcast match. We then perform player tracking to identify and track the movements of both players in each frame. Finally, we calculate the distance covered by each player and the average speed with which they move on the court. We further show a heatmap of the areas covered by the player on the court which is useful for analyzing the gameplay of the player. Our proposed framework was successfully used to analyze live broadcast matches in real-time during the Premier Badminton League 2019 (PBL 2019), with commentators and broadcasters appreciating the utility.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper aims to address the issue of real-time analysis of player movements in badminton broadcast videos. Specifically, the research objectives include:

1. **Propose an end-to-end framework**: Develop an end-to-end framework capable of real-time analysis of live badminton match videos, relying solely on visual input (i.e., match videos) without using multi-modal sensor data.

2. **Calculate on-court movement distance**: Calculate the distance players move on the court during the match. This involves removing replays and other redundant parts from the live video and focusing on the actual match process.

3. **Player tracking**: Identify and track the movements of the two players in each frame of the video.

4. **Speed and heatmap analysis**: Calculate the players' average speed based on their movement trajectories and generate heatmaps of their activity on the court, which is very useful for analyzing players' playing styles.

5. **Achieve real-time application**: Successfully apply the proposed framework to the live broadcast of the 2019 Premier Badminton League (PBL 2019), achieving real-time analysis of the matches.

6. **Build a diverse dataset**: To improve the generality and robustness of the method, the researchers constructed a diverse dataset, including singles and doubles match videos from different tournaments, with varying court colors and lighting conditions.

In summary, the main contribution of this paper is the proposal of a method that can analyze badminton player movements in real-time, and its effectiveness and practicality have been validated through application in actual events.