Abstract:In this current research work, we applied a Twin- Delayed DDPG (TD3) algorithm to solve the most challenging virtual Artificial Intelligence application by training a HalfCheetah robot as an Intelligent Agent to run across a field. Twin-Delayed DDPG (TD3) is a recent breakthrough smart AI model of a Deep Reinforcement Learning which combines the state-of-the-art techniques in Artificial Intelligence, including continuous Double Deep Q-Learning, Policy Gradient and Actor-Critic. These Deep Reinforcement Learning approaches have the capabilities to train an Intelligent agent to interact with an environment with automatic feature engineering, that is, requiring minimal domain knowledge. Twin-Delayed Deep Deterministic Policy Gradient algorithm (TD3) was built on the Deep Deterministic Policy Gradient algorithm (DDPG). During the implementation of the TD3 model, we used a two- layer feedforward neural network of 400 and 300 hidden nodes respectively, with Rectified Linear Units (ReLU) as an activation function between each layer for both the Actor and Critics, and then a final tanh unit following the output of the Actor. Overall, we developed six (6) neural networks. The Critic received both the state and action as input to the first layer. Both the network parameters were updated using the Adam optimizer. The implementation of the TD3 algorithm was made possible by using the pybullet continuous control environment which was interfaced through the OpenAI Gym. The idea behind the Twin-Delayed DDPG (TD3) is to reduce overestimation bias in Deep Q-Learning with discrete actions which are ineffective in an Actor-Critic domain setting. After exposing the Agent to training for 500,000 iterations, the Agent then achieved a Maximum Average Reward over the evaluation time-step of approximately 1891. Twin-Delayed Deep Deterministic Policy Gradient (TD3) has prominently improved both the learning speed and performance of the DDPG in a challenging task in a continuous control setting.

Twin-Delayed Ddpg: A Deep Reinforcement Learning Technique To Model A Continuous Movement Of An Intelligent Robot Agent

Modeling a Continuous Locomotion Behavior of an Intelligent Agent Using Deep Reinforcement Technique

Twin Delayed Multi-Agent Deep Deterministic Policy Gradient

Dueling Network Architecture for Multi-Agent Deep Deterministic Policy Gradient

A Dynamically Adaptive Approach to Reducing Strategic Interference for Multi-agent Systems

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Swap Softmax Twin Delayed Deep Deterministic Policy Gradient

A Novel Robotic Grasping Method for Moving Objects Based on Multi-Agent Deep Reinforcement Learning

D3PG: Decomposed Deep Deterministic Policy Gradient for Continuous Control

Multi-Agent Deep Deterministic Policy Gradient Algorithm Based on Classification Experience Replay

Asynchronous Episodic Deep Deterministic Policy Gradient: Toward Continuous Control in Computationally Complex Environments

Toward Obstacle Avoidance for Mobile Robots Using Deep Reinforcement Learning Algorithm

Data-efficient Deep Reinforcement Learning Method Toward Scaling Continuous Robotic Task with Sparse Rewards.

End-to-End Autonomous Driving Decision-Making Solution Based on Pri-TD3

Heuristic Gait Learning of Quadruped Robot Based on Deep Deterministic Policy Gradient Algorithm

The Design and Realization of Multi-agent Obstacle Avoidance based on Reinforcement Learning

Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning

Edge Delayed Deep Deterministic Policy Gradient: efficient continuous control for edge scenarios

Quadruped Robot Locomotion in Unknown Terrain Using Deep Reinforcement Learning

Improved Deep Deterministic Policy Gradient for Dynamic Obstacle Avoidance of Mobile Robot

Motion Simulation of Flying Quadruped Robot Based on Deep Reinforcement Learning