The tolerability of sunitinib in elderly patients with metastatic renal cancer.

Agnieszka Michael,Jermaine Coward,A. Brown,N. Barber,H. Pandha

DOI: https://doi.org/10.1016/j.clon.2015.01.012

2015-06-01

Clinics in Oncology

Abstract:

What problem does this paper attempt to address?

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

Zefang Lv,Guohang Niu,Liang Xiao,Chengwen Xing,Wenyuan Xu

DOI: https://doi.org/10.1109/twc.2023.3268082

2023-01-01

Abstract:The swarm relay and power allocation policy determines the bit error rate and the energy consumption of unmanned aerial vehicles (UAVs) and can be optimized based on the network and jamming model, which is rarely known by UAVs. In this paper, we propose a multi-agent reinforcement learning (RL)-based UAV swarm communication scheme to optimize the relay selection and power allocation against jamming. Based on the network topology, channel states, previous performance and observations shared by the neighboring UAVs, this scheme formulates the policy distribution to improve the policy exploration and applies a policy learning mechanism to stabilize the learning process. Based on transfer learning, the shared swarm experiences are exploited to accelerate the initial learning and improve policy optimization. A deep RL-based scheme is proposed to mitigate the state quantization error for the rapidly changing channel states under high swarm moving speed and thus further improve the anti-jamming performance. This scheme designs a policy network with four fully connected layers to approximate the policy distribution and uses another two neural networks to estimate the average policy distribution and the expected long-term utility, respectively, to update the policy network for stabilized deep learning. We investigate the computational complexity and derive the performance bound regarding the bit error rate, the energy consumption and the utility. Simulation and experimental results verify the performance gain of our proposed schemes over related works.
Deep Reinforcement Learning Based Three-Dimensional Area Coverage With UAV Swarm

Zhiyu Mou,Yu Zhang,Feifei Gao,Huangang Wang,Tao Zhang,Zhu Han

DOI: https://doi.org/10.1109/jsac.2021.3088718

IF: 16.4

2021-10-01

IEEE Journal on Selected Areas in Communications

Abstract:Unmanned aerial vehicle (UAV) technology is recognized as a promising solution to area coverage problems (ACPs) and has been extensively studied recently. In this paper, we study the 3D irregular terrain surface coverage problem with a hierarchical UAV swarm. We first build the 3D model of a random irregular terrain and propose a geometric way to project the 3D terrain surface into many weighted 2D patches. Then we develop a two-level hierarchical UAV swarm architecture, including the low-level follower UAVs (FUAVs) and the high-level leader UAVs (LUAVs). For FUAVs, we design a coverage trajectory algorithm to carry out specific coverage tasks within patches based on the star communication topology. For LUAVs, we propose a swarm deep Q-learning (SDQN) reinforcement learning algorithm to select patches. Moreover, an observation history model based on convolutional neural networks (CNNs) and the mean embedding method is integrated into SDQN to address the communication limitation problems of LUAVs. The numerical results show that FUAVs can cover the entire area of each patch with little redundancies, and the total coverage time of the SDQN is less than that of existing methods, which demonstrates the effectiveness of the proposed algorithms.

telecommunications,engineering, electrical & electronic
Oracle-Guided Deep Reinforcement Learning for Large-Scale Multi-UAVs Flocking and Navigation.

Wen Wang,Liang Wang,Junfeng Wu,Xianping Tao,Haijun Wu

DOI: https://doi.org/10.1109/tvt.2022.3184043

IF: 6.8

2022-01-01

IEEE Transactions on Vehicular Technology

Abstract:The flocking and navigation control of large-scale Unmanned Aerial Vehicle (UAV) swarms have received a lot of research interest due to the wide applications of UAVs in many fields. Compared to traditional non-learning-based flocking and navigation control methods, reinforcement learning-based methods have advantages in model-free, flexibility, and adaptability. In this paper, we formulate the flocking and navigation control of the UAV swarm as a Markov Decision Process (MDP) and use multi-agent reinforcement learning methods to solve the problem. There are two significant challenges introduced by reinforcement learning: the scalability issue and the partial observations of each UAV. We adopt the independent learning and parameter sharing scheme to tackle the scalability issue, which extends the single-agent reinforcement learning algorithms to the multi-agent scenario. For the partial observations, we propose an oracle-guided two-stage training and execution scheme, which utilizes the flock center during the training phase but avoids the dependence on the flock center during the execution phase. We design the oracle-guided observations and rewards and build a highly efficient simulation environment to conduct experiments. Simulation results show that the policy trained with our method performs well with up to thirty-two UAVs and outperforms the policy trained with local observations.
Application of Deep Reinforcement Learning in UAVs: A Review

Ruihui Wang,Li Xu

DOI: https://doi.org/10.1109/ccdc55256.2022.10034357

2022-01-01

Abstract:Deep reinforcement learning is one of the most important branches in the field of artificial intelligence. It has strong high-latitude data processing capabilities and is mainly used to solve control and decision-making problems. Many problems in the field of unmanned aerial vehicle(UAV) involve control and decision-making, so deep reinforcement learning has a wide range of applications in the field of UAVs. First, this article introduces the principles of classic reinforcement learning and extends to the principles of deep reinforcement learning. Secondly, this article describes the control and decision-making problems in the field of UAVs, and further introduces the application of deep reinforcement learning to these problems. Finally, this article looks forward to the future development direction of deep reinforcement learning in this field, and provides references for future related research.
Joint Communication and Action Learning in Multi-Target Tracking of UAV Swarms with Deep Reinforcement Learning

Wenhong Zhou,Jie Li,Qingjie Zhang

DOI: https://doi.org/10.3390/drones6110339

IF: 5.532

2022-11-02

Drones

Abstract:Communication is the cornerstone of UAV swarms to transmit information and achieve cooperation. However, artificially designed communication protocols usually rely on prior expert knowledge and lack flexibility and adaptability, which may limit the communication ability between UAVs and is not conducive to swarm cooperation. This paper adopts a new data-driven approach to study how reinforcement learning can be utilized to jointly learn the cooperative communication and action policies for UAV swarms. Firstly, the communication policy of a UAV is defined, so that the UAV can autonomously decide the content of the message sent out according to its real-time status. Secondly, neural networks are designed to approximate the communication and action policies of the UAV, and their policy gradient optimization procedures are deduced, respectively. Then, a reinforcement learning algorithm is proposed to jointly learn the communication and action policies of UAV swarms. Numerical simulation results verify that the policies learned by the proposed algorithm are superior to the existing benchmark algorithms in terms of multi-target tracking performance, scalability in different scenarios, and robustness under communication failures.
Continuous Deep Hierarchical Reinforcement Learning for Ground-Air Swarm Shepherding

Hung The Nguyen,Tung Duy Nguyen,Vu Phi Tran,Matthew Garratt,Kathryn Kasmarik,Sreenatha Anavatti,Michael Barlow,Hussein A. Abbass

DOI: https://doi.org/10.48550/arXiv.2004.11543

2020-08-27

Abstract:The control and guidance of multi-robots (swarm) is a non-trivial problem due to the complexity inherent in the coupled interaction among the group. Whether the swarm is cooperative or non-cooperative, lessons can be learnt from sheepdogs herding sheep. Biomimicry of shepherding offers computational methods for swarm control with the potential to generalize and scale in different environments. However, learning to shepherd is complex due to the large search space that a machine learner is faced with. We present a deep hierarchical reinforcement learning approach for shepherding, whereby an unmanned aerial vehicle (UAV) learns to act as an aerial sheepdog to control and guide a swarm of unmanned ground vehicles (UGVs). The approach extends our previous work on machine education to decompose the search space into a hierarchically organized curriculum. Each lesson in the curriculum is learnt by a deep reinforcement learning model. The hierarchy is formed by fusing the outputs of the model. The approach is demonstrated first in a high-fidelity robotic-operating-system (ROS)-based simulation environment, then with physical UGVs and a UAV in an in-door testing facility. We investigate the ability of the method to generalize as the models move from simulation to the real-world and as the models move from one scale to another.

Robotics,Multiagent Systems
Multi-Agent Reinforcement Learning Aided Intelligent UAV Swarm for Target Tracking

Zhaoyue Xia,Jun Du,Jingjing Wang,Chunxiao Jiang,Yong Ren,Gang Li,Zhu Han

DOI: https://doi.org/10.1109/tvt.2021.3129504

IF: 6.8

2022-01-01

IEEE Transactions on Vehicular Technology

Abstract:Past few years have witnessed the widespread adoption of unmanned aerial vehicles (UAVs) in target tracking for regional monitor and strike. Most existing target tracking approaches rely on the target motion frames obtained by the camera equipped, or on ideally assuming a pre-set target trajectory. However, in practice, the real trajectory of the target cannot be perfectly known to the UAVs in advance, and also the target may intelligently adjust its flying strategy according to the environment. Besides, the limited flight performance, as well as information capture and processing capability, of a single UAV can hardly fulfill high tracking success rate requirements. To address aforementioned issues, this paper proposes an end-to-end cooperative multi-agent reinforcement learning (MARL) scheme, where UAVs are enabled to make intelligent flight decisions for cooperative target tracking, on the basis of the past and current states of the target. In order to reduce power consumption and prolong the lifetime of the UAV tracking system, the propulsion power consumption model and energy saving strategy are introduced. Moreover, to further increase the detection coverage, spatial information entropy is introduced in the tracking algorithm. Simulation results show that our proposed algorithm outperfoms the deep reinforcement learning baselines in terms of the mean episode rewards, while also yields high performances with respect to tracking success rates, power saving efficiency and detection coverage.

telecommunications,engineering, electrical & electronic,transportation science & technology
UAV Swarm Cooperative Target Search: A Multi-Agent Reinforcement Learning Approach

Yukai Hou,Jin Zhao,Rongqing Zhang,Xiang Cheng,Liuqing Yang

DOI: https://doi.org/10.1109/tiv.2023.3316196

IF: 8.2

2023-01-01

IEEE Transactions on Intelligent Vehicles

Abstract:The development of machine learning and artificial intelligence algorithms, as well as the progress of unmanned aerial vehicle swarm technology, has significantly enhanced the intelligence and autonomy of unmanned aerial vehicles in search missions, resulting in greater efficiency when searching unknown areas. However, as search scenarios become more complex, the existing unmanned aerial vehicle swarm search method lacks scalability and efficient cooperation. Furthermore, due to the increasing scale of search scenarios, the accuracy and real-time performance of global information are difficult to ensure, necessitating the provision of local information. This paper focuses on the large-scale search scenario and split it to provide both local and global information for running unmanned aerial vehicle swarm search algorithms. Since the search environment is often unknown, dynamic, and complex, it requires adaptive decision-making in a constantly changing environment, which is suitable for modeling as a Markov decision process. Considering the sequential-based scenario, we propose a distributed collaborative search method based on a multi-agent reinforcement learning algorithm, which can operate efficiently in complex and large-scale scenarios. Additionally, the proposed method can utilize a convolutional neural network to process high-dimensional map data with almost no loss of the structure information. Experimental results demonstrate that the proposed method can collaboratively search unknown areas, avoid collisions and repetitions, and find all targets faster compared with the benchmarks.
UAV Swarm Confrontation Using Hierarchical Multiagent Reinforcement Learning

Baolai Wang,Shengang Li,Xianzhong Gao,Tao Xie

DOI: https://doi.org/10.1155/2021/3360116

IF: 1.4

2021-01-01

International Journal of Aerospace Engineering

Abstract:With the development of unmanned aerial vehicle (UAV) technology, UAV swarm confrontation has attracted many researchers’ attention. However, the situation faced by the UAV swarm has substantial uncertainty and dynamic variability. The state space and action space increase exponentially with the number of UAVs, so that autonomous decision-making becomes a difficult problem in the confrontation environment. In this paper, a multiagent reinforcement learning method with macro action and human expertise is proposed for autonomous decision-making of UAVs. In the proposed approach, UAV swarm is modeled as a large multiagent system (MAS) with an individual UAV as an agent, and the sequential decision-making problem in swarm confrontation is modeled as a Markov decision process. Agents in the proposed method are trained based on the macro actions, where sparse and delayed rewards, large state space, and action space are effectively overcome. The key to the success of this method is the generation of the macro actions that allow the high-level policy to find a near-optimal solution. In this paper, we further leverage human expertise to design a set of good macro actions. Extensive empirical experiments in our constructed swarm confrontation environment show that our method performs better than the other algorithms.
Three-Dimensional Area Coverage with UAV Swarm Based on Deep Reinforcement Learning

Zhiyu Mou,Yu Zhang,Feifei Gao,Huangang Wang,Tao Zhang,Zhu Han

DOI: https://doi.org/10.1109/icc42927.2021.9500895

2021-01-01

Abstract:In this paper, we study the fast coverage problem of 3D irregular terrain surfaces with a hierarchical UAV swarm. We first build a 3D model of a random irregular terrain and project the 3D terrain surface into many weighted 2D patches. Then we develop a two-level hierarchical UAV swarm architecture, including the low-level follower UAVs (FUAVs) and the high-level leader UAVs (LUAVs). For FUAVs, we adopt the traditional coverage trajectory algorithm to carry out specific coverage tasks within patches based on the star communication topology. For LUAVs, we propose a swarm deep Q-learning (SDQN) reinforcement learning algorithm to select patches. The numerical results show that the total coverage time of the SDQN is less than that of existing methods, which demonstrates the effectiveness of the proposed algorithm.
Multi-UAV Cooperative Target Tracking Based on Swarm Intelligence

Zhaoyue Xia,Jun Du,Chunxiao Jiang,Jingjing Wang,Yong Ren,Gang Li

DOI: https://doi.org/10.1109/icc42927.2021.9500771

2021-01-01

Abstract:In recent years, unmanned aerial vehicles (UAV) have been widely adopted to support complex target tracking tasks for military and civilian applications, especially in open and unknown environments. In practical cases, the moving trajectory of the target cannot be known to the UAVs in advance, which brings great challenges to UAVs to realize real-time and effective tracking. In addition, the limited tracking ability of a single UAV can hardly meet the requirements of a high tracking success rate. To deal with these problems above, this paper establishes a multi-UAV cooperative target tracking system. Besides, a deep reinforcement learning (DRL) based algorithm is designed to enable UAVs to make flight action decisions intelligently to track the moving air target, according to the past and current position information of the target only. To further increase the detection coverage of the UAV network when tracking, spatial information entropy is introduced to the reward designing in this algorithm. Simulation results validate that the proposed algorithm yields impressive target tracking performances, and significantly outperforms several common DRL baselines in terms of the tracking success rate. The convergence of the algorithm is also verified by the simulations.
Decentralized Reinforcement Learning for Multi-Target Search and Detection by a Team of Drones

Roi Yehoshua,Juan Heredia-Juesas,Yushu Wu,Christopher Amato,Jose Martinez-Lorenzo

DOI: https://doi.org/10.48550/arXiv.2103.09520

2021-03-17

Abstract:Targets search and detection encompasses a variety of decision problems such as coverage, surveillance, search, observing and pursuit-evasion along with others. In this paper we develop a multi-agent deep reinforcement learning (MADRL) method to coordinate a group of aerial vehicles (drones) for the purpose of locating a set of static targets in an unknown area. To that end, we have designed a realistic drone simulator that replicates the dynamics and perturbations of a real experiment, including statistical inferences taken from experimental data for its modeling. Our reinforcement learning method, which utilized this simulator for training, was able to find near-optimal policies for the drones. In contrast to other state-of-the-art MADRL methods, our method is fully decentralized during both learning and execution, can handle high-dimensional and continuous observation spaces, and does not require tuning of additional hyperparameters.

Robotics,Machine Learning,Multiagent Systems
[Conservative therapy of fecal incontinence].

M. Bittinger,J. Barnert,A. Moll,A. Majewicz,M. Wienbeck

Zentralblatt für Chirurgie

Abstract:Fecal incontinence is not diagnosis, but a symptom which can result from multiple causes. Therefore, therapy should attempt to treat the underlying disorder whenever possible. If this is not possible, therapy becomes symptom oriented. Besides drug treatment anal biofeedback training is the most important basis of medical therapy. Except for special situations surgery is indicated only if medical therapy has failed.
UAV Swarm Path Planning with Reinforcement Learning for Field prospecting

Alejandro Puente-Castro,Daniel Rivero,Alejandro Pazos,Enrique Fernandez-Blanco

DOI: https://doi.org/10.1007/s10489-022-03254-4

2021-06-04

Abstract:Unmanned Aerial Vehicle (UAV) swarms adoption shows a steady growth among operators due to the benefits in time and cost arisen from their use. However, this kind of system faces an important problem which is the calculation of many optimal paths for each UAV. Solving this problem would allow a to control many UAVs without human intervention at the same time while saving battery between recharges and performing several tasks simultaneously. The main aim is to develop a system capable of calculating the optimal flight path for a UAV swarm. The aim of these paths is to achieve full coverage of a flight area for tasks such as field prospection. All this, regardless of the size of maps and the number of UAVs in the swarm. It is not necessary to establish targets or any other previous knowledge other than the given map. Experiments have been conducted to determine whether it is optimal to establish a single control for all UAVs in the swarm or a control for each UAV. The results show that it is better to use one control for all UAVs because of the shorter flight time. In addition, the flight time is greatly affected by the size of the map. The results give starting points for future research such as finding the optimal map size for each situation.

Multiagent Systems
Multi-target tracking for unmanned aerial vehicle swarms using deep reinforcement learning

Wenhong Zhou,Zhihong Liu,Jie Li,Xin Xu,Lincheng Shen

DOI: https://doi.org/10.1016/j.neucom.2021.09.044

IF: 6

2021-11-01

Neurocomputing

Abstract:In recent years, deep reinforcement learning (DRL) has proved its great potential in multi-agent cooperation. However, how to apply DRL to multi-target tracking (MTT) problem for unmanned aerial vehicle (UAV) swarms is challenging: 1) the scale of UAVs may be large, but the existing multi-agent reinforcement learning (MARL) methods that rely on global or joint information of all agents suffer from the dimensionality curse; 2) the dimension of each UAV's received information is variable, which is incompatible with the neural networks with fixed input dimensions; 3) the UAVs are homogeneous and interchangeable that each UAV's policy should be irrelevant to the permutation of its received information. To this end, we propose a DRL method for UAV swarms to solve the MTT problem. Firstly, a decentralized swarm-oriented Markov Decision Process (MDP) model is presented for UAV swarms, which involves each UAV's local communication and partial observation. Secondly, to achieve better scalability, a cartogram feature representation (FR) is proposed to integrate the variable-dimensional information set into a fixed-shape input variable, and the cartogram FR can also maintain the permutation irrelevance to the information. Then, the double deep Q-learning network with dueling architecture is adapted to the MTT problem, and the experience-sharing training mechanism is adopted to learn the shared cooperative policy for UAV swarms. Extensive experiments are provided and the results show that our method can successfully learn a cooperative tracking policy for UAV swarms and outperforms the baseline method in the tracking ratio and scalability.

computer science, artificial intelligence
PASCAL: PopulAtion-Specific Curriculum-based MADRL for collision-free flocking with large-scale fixed-wing UAV swarms

Chao Yan,Xiaojia Xiang,Chang Wang,Fei Li,Xiangke Wang,Xin Xu,Lincheng Shen

DOI: https://doi.org/10.1016/j.ast.2022.108091

IF: 5.457

2023-02-01

Aerospace Science and Technology

Abstract:Flocking with a swarm of unmanned aerial vehicles (UAVs) has been playing an important role in various applications. However, the complexity of developing a collision-free flocking policy for a UAV swarm increases tremendously with the swarm scale. In this paper, a novel curriculum-based multi-agent deep reinforcement learning (MADRL) approach is proposed for flocking with collision avoidance of large-scale fixed-wing UAV swarms by progressively increasing the population of UAVs, which we call PopulAtion-Specific Curriculum-based MADRL (PASCAL). Specifically, PASCAL has two core components of policy learning and knowledge transfer. For policy learning, an improved multi-agent deep deterministic policy gradient algorithm is proposed to accelerate the learning process. For knowledge transfer, an attention-based population-invariant network is designed to handle dynamic dimensional inputs, enabling the reloading and fine-tuning of the previously learned models. Finally, both numerical and semi-physical simulations demonstrate the advantages of PASCAL in terms of learning efficiency and generalization capability for different swarm scales.

engineering, aerospace
Decentralized Control of Quadrotor Swarms with End-to-end Deep Reinforcement Learning

Sumeet Batra,Zhehui Huang,Aleksei Petrenko,Tushar Kumar,Artem Molchanov,Gaurav S. Sukhatme

DOI: https://doi.org/10.48550/arXiv.2109.07735

IF: 3.7

2021-09-16

Robotics

Abstract:We demonstrate the possibility of learning drone swarm controllers that are zero-shot transferable to real quadrotors via large-scale multi-agent end-to-end reinforcement learning. We train policies parameterized by neural networks that are capable of controlling individual drones in a swarm in a fully decentralized manner. Our policies, trained in simulated environments with realistic quadrotor physics, demonstrate advanced flocking behaviors, perform aggressive maneuvers in tight formations while avoiding collisions with each other, break and re-establish formations to avoid collisions with moving obstacles, and efficiently coordinate in pursuit-evasion tasks. We analyze, in simulation, how different model architectures and parameters of the training regime influence the final performance of neural swarms. We demonstrate the successful deployment of the model learned in simulation to highly resource-constrained physical quadrotors performing station keeping and goal swapping behaviors. Code and video demonstrations are available on the project website at https://sites.google.com/view/swarm-rl.
Scalable and Cooperative Deep Reinforcement Learning Approaches for Multi-UAV Systems: A Systematic Review

Francesco Frattolillo,Damiano Brunori,Luca Iocchi

DOI: https://doi.org/10.3390/drones7040236

IF: 5.532

2023-03-28

Drones

Abstract:In recent years, the use of multiple unmanned aerial vehicles (UAVs) in various applications has progressively increased thanks to advancements in multi-agent system technology, which enables the accomplishment of complex tasks that require cooperative and coordinated abilities. In this article, multi-UAV applications are grouped into five classes based on their primary task: coverage, adversarial search and game, computational offloading, communication, and target-driven navigation. By employing a systematic review approach, we select the most significant works that use deep reinforcement learning (DRL) techniques for cooperative and scalable multi-UAV systems and discuss their features using extensive and constructive critical reasoning. Finally, we present the most likely and promising research directions by highlighting the limitations of the currently held assumptions and the constraints when dealing with collaborative DRL-based multi-UAV systems. The suggested areas of research can enhance the transfer of knowledge from simulations to real-world environments and can increase the responsiveness and safety of UAV systems.
Game of Drones: Multi-UAV Pursuit-Evasion Game With Online Motion Planning by Deep Reinforcement Learning

Liqian Dou,Xiuyun Zhang,Q. Zong,Ruilong Zhang,Bailing Tian

DOI: https://doi.org/10.1109/TNNLS.2022.3146976

IF: 14.255

2022-02-14

IEEE Transactions on Neural Networks and Learning Systems

Abstract:As one of the tiniest flying objects, unmanned aerial vehicles (UAVs) are often expanded as the “swarm” to execute missions. In this article, we investigate the multiquadcopter and target pursuit-evasion game in the obstacles environment. For high-quality simulation of the urban environment, we propose the pursuit-evasion scenario (PES) framework to create the environment with a physics engine, which enables quadcopter agents to take actions and interact with the environment. On this basis, we construct multiagent coronal bidirectionally coordinated with target prediction network (CBC-TP Net) with a vectorized extension of multiagent deep deterministic policy gradient (MADDPG) formulation to ensure the effectiveness of the damaged “swarm” system in pursuit-evasion mission. Unlike traditional reinforcement learning, we design a target prediction network (TP Net) innovatively in the common framework to imitate the way of human thinking: situation prediction is always before decision-making. The experiments of the pursuit-evasion game are conducted to verify the state-of-the-art performance of the proposed strategy, both in the normal and antidamaged situations.

Computer Science,Medicine,Engineering
Control and Coordination of a SWARM of Unmanned Surface Vehicles using Deep Reinforcement Learning in ROS

Shrudhi R S,Sreyash Mohanty,Susan Elias

DOI: https://doi.org/10.48550/arXiv.2304.08189

2023-04-17

Abstract:An unmanned surface vehicle (USV) can perform complex missions by continuously observing the state of its surroundings and taking action toward a goal. A SWARM of USVs working together can complete missions faster, and more effectively than a single USV alone. In this paper, we propose an autonomous communication model for a swarm of USVs. The goal of this system is to implement a software system using Robot Operating System (ROS) and Gazebo. With the main objective of coordinated task completion, the Markov decision process (MDP) provides a base to formulate a task decision problem to achieve efficient localization and tracking in a highly dynamic water environment. To coordinate multiple USVs performing real-time target tracking, we propose an enhanced multi-agent reinforcement learning approach. Our proposed scheme uses MA-DDPG, or Multi-Agent Deep Deterministic Policy Gradient, an extension of the Deep Deterministic Policy Gradients (DDPG) algorithm that allows for decentralized control of multiple agents in a cooperative environment. MA-DDPG's decentralised control allows each and every agent to make decisions based on its own observations and objectives, which can lead to superior gross performance and improved stability. Additionally, it provides communication and coordination among agents through the use of collective readings and rewards.

Robotics

The tolerability of sunitinib in elderly patients with metastatic renal cancer.

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

Deep Reinforcement Learning Based Three-Dimensional Area Coverage With UAV Swarm

Oracle-Guided Deep Reinforcement Learning for Large-Scale Multi-UAVs Flocking and Navigation.

Application of Deep Reinforcement Learning in UAVs: A Review

Joint Communication and Action Learning in Multi-Target Tracking of UAV Swarms with Deep Reinforcement Learning

Continuous Deep Hierarchical Reinforcement Learning for Ground-Air Swarm Shepherding

Multi-Agent Reinforcement Learning Aided Intelligent UAV Swarm for Target Tracking

UAV Swarm Cooperative Target Search: A Multi-Agent Reinforcement Learning Approach

UAV Swarm Confrontation Using Hierarchical Multiagent Reinforcement Learning

Three-Dimensional Area Coverage with UAV Swarm Based on Deep Reinforcement Learning

Multi-UAV Cooperative Target Tracking Based on Swarm Intelligence

Decentralized Reinforcement Learning for Multi-Target Search and Detection by a Team of Drones

[Conservative therapy of fecal incontinence].

UAV Swarm Path Planning with Reinforcement Learning for Field prospecting

Multi-target tracking for unmanned aerial vehicle swarms using deep reinforcement learning

PASCAL: PopulAtion-Specific Curriculum-based MADRL for collision-free flocking with large-scale fixed-wing UAV swarms

Decentralized Control of Quadrotor Swarms with End-to-end Deep Reinforcement Learning

Scalable and Cooperative Deep Reinforcement Learning Approaches for Multi-UAV Systems: A Systematic Review

Game of Drones: Multi-UAV Pursuit-Evasion Game With Online Motion Planning by Deep Reinforcement Learning

Control and Coordination of a SWARM of Unmanned Surface Vehicles using Deep Reinforcement Learning in ROS