Combining Vision, Machine Learning and Automatic Control to Play the Labyrinth Game

Kristoffer Öfjäll,Michael Felsberg

DOI: https://doi.org/10.48550/arXiv.1604.00975

2016-02-02

Abstract:The labyrinth game is a simple yet challenging platform, not only for humans but also for control algorithms and systems. The game is easy to understand but still very hard to master. From a system point of view, the ball behaviour is in general easy to model but close to the obstacles there are severe non-linearities. Additionally, the far from flat surface on which the ball rolls provides for changing dynamics depending on the ball position. The general dynamics of the system can easliy be handled by traditional automatic control methods. Taking the obstacles and uneaven surface into accout would require very detailed models of the system. A simple deterministic control algorithm is combined with a learning control method. The simple control method provides initial training data. As the learning method is trained, the system can learn from the results of its own actions and the performance improves well beyond the performance of the initial controller. A vision system and image analysis is used to estimate the ball position while a combination of a PID controller and a learning controller based on LWPR is used to learn to navigate the ball through the maze.

Systems and Control,Robotics

What problem does this paper attempt to address?

The paper attempts to address the problem of achieving precise control of a ball in a maze game by combining vision systems, machine learning, and automatic control techniques. Specifically, although the rules of the maze game are simple, the actual operation is very challenging, especially when approaching obstacles where the system's nonlinear behavior is very complex. Traditional automatic control methods can handle the overall dynamics of the system but perform poorly when dealing with local nonlinearities caused by obstacles and uneven surfaces. Therefore, the authors propose a method that combines a traditional PID controller with a learning controller based on Locally Weighted Projection Regression (LWPR) to improve control performance.

The main objectives of the paper include:
1. **Designing an integrated control system**: Combining a vision system to obtain the ball's position information, using a PID controller for initial control, and gradually optimizing the control strategy through the LWPR learning controller.
2. **Evaluating the performance of different control strategies**: Comparing the performance of the PID controller, LWPR-2, and LWPR-4 control strategies in handling the maze game by testing them in different scenarios.
3. **Validating the effectiveness of the learning controller**: Experimentally verifying whether the learning controller can improve control performance through its learning process without a detailed system model, ultimately surpassing the initial PID controller.

Overall, the paper aims to explore how modern control theory and machine learning techniques can be utilized to solve complex nonlinear control problems in the maze game, thereby achieving more precise ball navigation.