Abstract:This paper presents a solution for an autonomously driven vehicle (a robotic car) based on artificial intelligence using a supervised learning method. A scaled-down robotic car containing only one camera as a sensor was developed to participate in the RoboCup Portuguese Open Autonomous Driving League competition. This study is based solely on the development of this robotic car, and the results presented are only from this competition. Teams usually solve the competition problem by relying on computer vision algorithms, and no research could be found on neural network model-based assistance for vehicle control. This technique is commonly used in general autonomous driving, and the amount of research is increasing. To train a neural network, a large number of labelled images is necessary; however, these are difficult to obtain. In order to address this problem, a graphical simulator was used with an environment containing the track and the robot/car to extract images for the dataset. A classical computer vision algorithm developed by the authors processes the image data to extract relevant information about the environment and uses it to determine the optimal direction for the vehicle to follow on the track, which is then associated with the respective image-grab. Several trainings were carried out with the created dataset to reach the final neural network model; tests were performed within a simulator, and the effectiveness of the proposed approach was additionally demonstrated through experimental results in two real robotics cars, which performed better than expected. This system proved to be very successful in steering the robotic car on a road-like track, and the agent's performance increased with the use of supervised learning methods. With computer vision algorithms, the system performed an average of 23 complete laps around the track before going off-track, whereas with assistance from the neural network model the system never went off the track.

Imitation Learning for End to End Vehicle Longitudinal Control with Forward Camera

Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectory

A LiDAR Based End to End Controller for Robot Navigation Using Deep Neural Network

End-to-End Driving via Self-Supervised Imitation Learning Using Camera and LiDAR Data

End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars with Visual Perception

End-to-End Learning of Driving Models from Large-Scale Video Datasets

Conditional Vehicle Trajectories Prediction in CARLA Urban Environment

Learning End-to-End Autonomous Steering Model from Spatial and Temporal Visual Cues

Autonomous Vehicle Control: End-to-end Learning in Simulated Urban Environments

LiDAR-as-Camera for End-to-End Driving

Reinforcement Learning and Deep Learning based Lateral Control for Autonomous Driving

Autonomous driving in traffic with end-to-end vision-based deep learning

Towards Safety Assured End-to-End Vision-Based Control for Autonomous Racing

Robust Behavioral Cloning for Autonomous Vehicles Using End-to-End Imitation Learning

Deep Steering: Learning End-to-End Driving Model from Spatial and Temporal Visual Cues

Deep learning and control algorithms of direct perception for autonomous driving

End-to-End Learning with Memory Models for Complex Autonomous Driving Tasks in Indoor Environments

Vision-based reinforcement learning for lane-tracking control

Imitation Learning for Vision-based Lane Keeping Assistance

Rapid Autonomous Car Control based on Spatial and Temporal Visual Cues

End-to-End Approach for Autonomous Driving: A Supervised Learning Method Using Computer Vision Algorithms for Dataset Creation