Abstract:One of the essential attributes of a cleaning robot is to achieve complete area coverage. Current commercial indoor cleaning robots have fixed morphology and are restricted to clean only specific areas in a house. The results of maximum area coverage are sub-optimal in this case. Tiling robots are innovative solutions for such a coverage problem. These new kinds of robots can be deployed in the cases of cleaning, painting, maintenance, and inspection, which require complete area coverage. Tiling robots' objective is to cover the entire area by reconfiguring to different shapes as per the area requirements. In this context, it is vital to have a framework that enables the robot to maximize the area coverage while minimizing energy consumption. That means it is necessary for the robot to cover the maximum area with the least number of shape reconfigurations possible. The current paper proposes a complete area coverage planning module for the modified hTrihex, a honeycomb-shaped tiling robot, based on the deep reinforcement learning technique. This framework simultaneously generates the tiling shapes and the trajectory with minimum overall cost. In this regard, a convolutional neural network (CNN) with long short term memory (LSTM) layer was trained using the actor-critic experience replay (ACER) reinforcement learning algorithm. The simulation results obtained from the current implementation were compared against the results that were generated through traditional tiling theory models that included zigzag, spiral, and greedy search schemes. The model presented in the current paper was also compared against other methods where this problem was considered as a traveling salesman problem (TSP) solved through genetic algorithm (GA) and ant colony optimization (ACO) approaches. Our proposed scheme generates a path with a minimized cost at a lesser time.

Simulating Coverage Path Planning with Roomba

Reinforcement Learning-Based Coverage Path Planning with Implicit Cellular Decomposition

Learning Coverage Paths in Unknown Environments with Deep Reinforcement Learning

A neural network approach to complete coverage path planning

Combined Coverage Path Planning for Autonomous Cleaning Robots in Unstructured Environments

Enhancing Offline Coverage Path Planning with Deep Reinforcement Learning

A Complete Coverage Path Planning Algorithm for Cleaning Robots Based on the Distance Transform Algorithm and the Rolling Window Approach in Dynamic Environments

Robot path planning using deep reinforcement learning

Sim-to-Real Transfer of Deep Reinforcement Learning Agents for Online Coverage Path Planning

Autonomous search of real-life environments combining dynamical system-based path planning and unsupervised learning

An Optimized Cleaning Robot Path Generation and Execution System using Cellular Representation of Workspace

Sensor-based Complete Coverage Path Planning in Dynamic Environment for Cleaning Robot

Reinforcement Learning-Based Complete Area Coverage Path Planning for a Modified hTrihex Robot

Full Coverage Traversed Path Planning and Simulation of Intelligence Cleaning Robot

A survey on coverage path planning for robotics

Path Planning of Cleaning Robot with Reinforcement Learning

An Indoor Blind Area-Oriented Autonomous Robotic Path Planning Approach Using Deep Reinforcement Learning

Research on Game-Playing Agents Based on Deep Reinforcement Learning.

Deep Reinforcement Learning for Mobile Robot Path Planning

Mapless Path Planning of Multi-robot Systems in Complex Environments Via Deep Reinforcement Learning

Research on path planning of robot based on deep reinforcement learning