Abstract:RoboCupJunior is a project-oriented competition for primary and secondary school students that promotes robotics, computer science and programing. Through real life scenarios, students are encouraged to engage in robotics in order to help people. One of the popular categories is Rescue Line, in which an autonomous robot has to find and rescue victims. The victim is in the shape of a silver ball that reflects light and is electrically conductive. The robot should find the victim and place it in the evacuation zone. Teams mostly detect victims (balls) using random walk or distant sensors. In this preliminary study, we explored the possibility of using a camera, Hough transform (HT) and deep learning methods for finding and locating balls with the educational mobile robot Fischertechnik with Raspberry Pi (RPi). We trained, tested and validated the performance of different algorithms (convolutional neural networks for object detection and U-NET architecture for sematic segmentation) on a handmade dataset made of images of balls in different light conditions and surroundings. RESNET50 was the most accurate, and MOBILENET_V3_LARGE_320 was the fastest object detection method, while EFFICIENTNET-B0 proved to be the most accurate, and MOBILENET_V2 was the fastest semantic segmentation method on the RPi. HT was by far the fastest method, but produced significantly worse results. These methods were then implemented on a robot and tested in a simplified environment (one silver ball with white surroundings and different light conditions) where HT had the best ratio of speed and accuracy (4.71 s, DICE 0.7989, IoU 0.6651). The results show that microcomputers without GPUs are still too weak for complicated deep learning algorithms in real-time situations, although these algorithms show much higher accuracy in complicated environment situations.

Ball Detection and Tracking through Image Processing using Python

A Learning Framework Towards Real-Time Detection and Localization of a Ball for Robotic Table Tennis System

Real-time vision system for a Ping-Pong robot

Vision based ping-pong ball tracking with physical model

Real-Time Spin Estimation of Ping-Pong Ball Using Its Natural Brand.

Design and Implementation of A Soccer Ball Detection System with Multiple Cameras

Accurate ball trajectory tracking and 3D visualization for computer-assisted sports broadcast

Tracking the Soccer Ball Using Multiple Fixed Cameras

Deep-Learning-Based Computer Vision Approach For The Segmentation Of Ball Deliveries And Tracking In Cricket

TrackNet: A Deep Learning Network for Tracking High-speed and Tiny Objects in Sports Applications

Ball-Catching System Using Image Processing and an Omni-Directional Wheeled Mobile Robot

Multi-feature based high-speed ball shape target tracking

Real-time 3D Soccer Ball Tracking from Multiple Cameras

Real-time 3D Football Ball Tracking from Multiple Cameras

A Three-Level Scheme For Real-Time Ball Tracking

Efficient Golf Ball Detection and Tracking Based on Convolutional Neural Networks and Kalman Filter

Ball Detection Using Deep Learning Implemented on an Educational Robot Based on Raspberry Pi

Machine Vision-Based Ping Pong Ball Rotation Trajectory Tracking Algorithm

Ball 3D Localization From A Single Calibrated Image

A scheme for ball detection and tracking in broadcast soccer video

Real-Time Modeling of 3-D Soccer Ball Trajectories from Multiple Fixed Cameras.