Abstract:The autonomous driving technology based on deep reinforcement learning (DRL) has been confirmed as one of the most cutting-edge research fields worldwide. The agent is enabled to achieve the goal of making independent decisions by interacting with the environment and learning driving strategies based on the feedback from the environment. This technology has been widely used in end-to-end driving tasks. However, this field faces several challenges. First, developing real vehicles is expensive, time-consuming, and risky. To further expedite the testing, verification, and iteration of end-to-end deep reinforcement learning algorithms, a joint simulation development and validation platform was designed and implemented in this study based on VTD–CarSim and the Tensorflow deep learning framework, and research work was conducted based on this platform. Second, sparse reward signals can cause problems (e.g., a low-sample learning rate). It is imperative for the agent to be capable of navigating in an unfamiliar environment and driving safely under a wide variety of weather or lighting conditions. To address the problem of poor generalization ability of the agent to unknown scenarios, a deep deterministic policy gradient (DDPG) decision-making and planning method was proposed in this study in accordance with a multi-task fusion strategy. The main task based on DRL decision-making planning and the auxiliary task based on image semantic segmentation were cross-fused, and part of the network was shared with the main task to reduce the possibility of model overfitting and improve the generalization ability. As indicated by the experimental results, first, the joint simulation development and validation platform built in this study exhibited prominent versatility. Users were enabled to easily substitute any default module with customized algorithms and verify the effectiveness of new functions in enhancing overall performance using other default modules of the platform. Second, the deep reinforcement learning strategy based on multi-task fusion proposed in this study was competitive. Its performance was better than other DRL algorithms in certain tasks, which improved the generalization ability of the vehicle decision-making planning algorithm.

DRL-Based Intelligent Extinguishing Strategy for Firefighting Robots

An Indoor Autonomous Inspection and Firefighting Robot Based on SLAM and Flame Image Recognition

Firefighting robot with deep learning and machine vision

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

A Feasible System of Automatic Flame Detection and Tracking for Fire-fighting Robot

Firefighting Robot Extinguishment Decision‐Making Based on Visual Guidance: A Novel Attention and Scale U‐Net Model and Genetic Algorithm

Efficient Multi-agent Navigation with Lightweight DRL Policy

Robot Control in Human Environment Using Deep Reinforcement Learning and Convolutional Neural Network.

Design of intelligent fire-fighting robot based on multi-sensor fusion and experimental study on fire scene patrol

Deep Reinforcement Learning for Flipper Control of Tracked Robots

A data-efficient goal-directed deep reinforcement learning method for robot visuomotor skill

A Fire Protection Robot System Based on SLAM Localization and Fire Source Identification

Deep Reinforcement Learning for Robot Collision Avoidance With Self-State-Attention and Sensor Fusion

A Multi-Task Fusion Strategy-Based Decision-Making and Planning Method for Autonomous Driving Vehicles

Deep reinforcement learning-based safe interaction for industrial human-robot collaboration using intrinsic reward function

Learning of Long-Horizon Sparse-Reward Robotic Manipulator Tasks With Base Controllers

Automated Fire Extinguishing System Using a Deep Learning Based Framework

Integrating human experience in deep reinforcement learning for multi-UAV collision detection and avoidance

FireRobBrain: Planning for a Firefighting Robot using Knowledge Graph and Large Language Model

PyroTrack: Belief-Based Deep Reinforcement Learning Path Planning for Aerial Wildfire Monitoring in Partially Observable Environments

Design of a small wheel-foot hybrid firefighting robot for infrared visual fire recognition