Accurate Tennis Court Line Detection on Amateur Recorded Matches

Sameer Agrawal,Ragoth Sundararajan,Vishak Sagar
2024-04-10
Abstract:Typically, tennis court line detection is done by running Hough-Line-Detection to find straight lines in the image, and then computing a transformation matrix from the detected lines to create the final court structure. We propose numerous improvements and enhancements to this algorithm, including using pretrained State-of-the-Art shadow-removal and object-detection ML models to make our line-detection more robust. Compared to the original algorithm, our method can accurately detect lines on amateur, dirty courts. When combined with a robust ball-tracking system, our method will enable accurate, automatic refereeing for amateur and professional tennis matches alike.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The paper aims to address the issue of inaccurate tennis court line detection in amateur-recorded tennis matches. Traditional tennis court line detection methods typically rely on the Hough Transform to identify straight lines in images and calculate a transformation matrix from the detected lines to create the final court structure. However, in practical applications, especially in videos recorded in non-professional environments, this method faces numerous challenges, such as low camera angles leading to the far end of the court being invisible, severe court wear, or shadow occlusion. The main contributions of the paper include a series of improvements, specifically: 1. **Color Filtering Algorithm**: To handle poor lighting conditions and unclear white lines, a filtering algorithm based on court color detection is proposed, removing the parts identified as the court from the image. 2. **Perspective Correction**: When the camera is at a low angle, the YOLO object detection model is used to identify the net position, crop the near-end court image, and then extend it to address the issue of the far side being difficult to see. 3. **Shadow Elimination**: Advanced shadow removal models (such as ShadowFormer) are used to process shadow-covered parts, allowing the algorithm to better parse the image. 4. **Scoring Algorithm**: The detection accuracy is evaluated by comparing the detection results with the number of bright pixels in the original image, thereby selecting the best court detection result. These improvements make the new method more accurate in handling amateur and dirty courts, with the potential to achieve automatic refereeing functions when combined with a robust ball tracking system, suitable for both professional and non-professional matches.