End-to-end deep learning-based framework for path planning and collision checking: bin-picking application – ERRATUM

Mehran Ghafarian Tamizi,Homayoun Honari,Aleksey Nozdryn-Plotnicki,Homayoun Najjaran

DOI: https://doi.org/10.1017/s0263574724001942

IF: 2.7

2024-11-08

Robotica

Abstract://static.cambridge.org/content/id/urn%3Acambridge.org%3Aid%3Aarticle%3AS0263574724001942/resource/name/firstPage-pdf-S0263574724001942a.jpg

robotics

What problem does this paper attempt to address?

End-to-end deep learning-based framework for path planning and collision checking: bin picking application

Mehran Ghafarian Tamizi,Homayoun Honari,Aleksey Nozdryn-Plotnicki,Homayoun Najjaran

DOI: https://doi.org/10.1017/S0263574724000109

2023-04-01

Abstract:Real-time and efficient path planning is critical for all robotic systems. In particular, it is of greater importance for industrial robots since the overall planning and execution time directly impact the cycle time and automation economics in production lines. While the problem may not be complex in static environments, classical approaches are inefficient in high-dimensional environments in terms of planning time and optimality. Collision checking poses another challenge in obtaining a real-time solution for path planning in complex environments. To address these issues, we propose an end-to-end learning-based framework viz., Path Planning and Collision checking Network (PPCNet). The PPCNet generates the path by computing waypoints sequentially using two networks: the first network generates a waypoint, and the second one determines whether the waypoint is on a collision-free segment of the path. The end-to-end training process is based on imitation learning that uses data aggregation from the experience of an expert planner to train the two networks, simultaneously. We utilize two approaches for training a network that efficiently approximates the exact geometrical collision checking function. Finally, the PPCNet is evaluated in two different simulation environments and a practical implementation on a robotic arm for a bin-picking application. Compared to the state-of-the-art path planning methods, our results show significant improvement in performance by greatly reducing the planning time with comparable success rates and path lengths.

Robotics,Systems and Control
End-to-end deep learning-based framework for path planning and collision checking: bin-picking application

Mehran Ghafarian Tamizi,Homayoun Honari,Aleksey Nozdryn-Plotnicki,Homayoun Najjaran

DOI: https://doi.org/10.1017/s0263574724000109

IF: 2.7

2024-02-14

Robotica

Abstract:Real-time and efficient path planning is critical for all robotic systems. In particular, it is of greater importance for industrial robots since the overall planning and execution time directly impact the cycle time and automation economics in production lines. While the problem may not be complex in static environments, classical approaches are inefficient in high-dimensional environments in terms of planning time and optimality. Collision checking poses another challenge in obtaining a real-time solution for path planning in complex environments. To address these issues, we propose an end-to-end learning-based framework viz., Path Planning and Collision checking Network (PPCNet). The PPCNet generates the path by computing waypoints sequentially using two networks: the first network generates a waypoint, and the second one determines whether the waypoint is on a collision-free segment of the path. The end-to-end training process is based on imitation learning that uses data aggregation from the experience of an expert planner to train the two networks, simultaneously. We utilize two approaches for training a network that efficiently approximates the exact geometrical collision checking function. Finally, the PPCNet is evaluated in two different simulation environments and a practical implementation on a robotic arm for a bin-picking application. Compared to the state-of-the-art path-planning methods, our results show significant improvement in performance by greatly reducing the planning time with comparable success rates and path lengths.

robotics
Optimization-based Motion Planning for Autonomous Parking Considering Dynamic Obstacle: A Hierarchical Framework

Xuemin Chi,Zhitao Liu,Jihao Huang,Feng Hong,Hongye Su

DOI: https://doi.org/10.1109/ccdc55256.2022.10033904

2022-01-01

Abstract:This paper introduces a hierarchical framework that integrates graph search algorithms and model predictive control to facilitate efficient parking maneuvers for Autonomous Vehicles (AVs) in constrained environments. In the high-level planning phase, the framework incorporates scenario-based hybrid A* (SHA*), an optimized variant of traditional Hybrid A*, to generate an initial path while considering static obstacles. This global path serves as an initial guess for the low-level NLP problem. In the low-level optimizing phase, a nonlinear model predictive control (NMPC)-based framework is deployed to circumvent dynamic obstacles. The performance of SHA* is empirically validated through 148 simulation scenarios, and the efficacy of the proposed hierarchical framework is demonstrated via a real-time parallel parking simulation.
A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

Hongxiang Yu,Qianen Lai,Yuwei Liang,Yue Wang,Rong Xiong

DOI: https://doi.org/10.1109/robio49542.2019.8961531

2019-01-01

Abstract:Robotic grasping has been regarded as an essential way for robots to interact with the environment, which makes it a research hotspot. To our knowledge, current work on grasp planning could rarely take both robustness and time efficiency into account. To solve this problem, we propose a cascaded deep learning framework, which consists of a regression CNN and a refined CNN. Taking depth image as input, the first network regresses an optimal grasp region. The second network samples and sorts grasp candidates in the region and finally outputs a series of grasp poses with high quality. This architecture ensures real-time performance and acquisition of adequate candidates synchronously, which is especially appropriate for unstructured environment manipulation. We used Gazebo simulation and DART physics engines to build a grasp data generation environment. Comparing with manually annotating or robot collecting, our method makes data generation less expensive, more dynamic, and easier to generalize into the real world. The method proposed is evaluated in both simulation and physical experiments, verifying that our method is able to find multiple robuster grasp poses at a faster rate than the state of the art.
Automatic Object Searching and Behavior Learning for Mobile Robots in Unstructured Environment by Deep Belief Networks.

Jiru Wang,Vui Ann Shim,Rui Yan,Huajin Tang,Fuchun Sun

DOI: https://doi.org/10.1109/tcds.2018.2841002

IF: 4.546

2019-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:Automatic object searching is one of the essential skills for domestic robots to operate in unstructured human environments. It involves concatenation of several capabilities, including object identification, obstacle avoidance, path planning, and navigation. In this paper, we propose an automatic object searching framework for a mobile robot equipped with a single RGB-D camera. The obstacle avoidance is achieved by a behavior learning algorithm based on deep belief networks. The target object is recognized using scale-invariant feature transform descriptors and the relative position between the target and mobile robot is estimated from the RGB-D data. Subsequently, the mobile robot makes a path planning to the target location using an improved bug-based algorithm. The framework is tested in indoor environments and requires the robot to perform obstacle avoidance and automatically search and approach the target object. The results indicate that the system is collision free and reliable in performing searching tasks. This system's functions make itself have the potential of being used for local navigation in unstructured environments.
Safe and Efficient Path Planning under Uncertainty via Deep Collision Probability Fields

Felix Herrmann,Sebastian Zach,Jacopo Banfi,Jan Peters,Georgia Chalvatzaki,Davide Tateo

2024-09-06

Abstract:Estimating collision probabilities between robots and environmental obstacles or other moving agents is crucial to ensure safety during path planning. This is an important building block of modern planning algorithms in many application scenarios such as autonomous driving, where noisy sensors perceive obstacles. While many approaches exist, they either provide too conservative estimates of the collision probabilities or are computationally intensive due to their sampling-based nature. To deal with these issues, we introduce Deep Collision Probability Fields, a neural-based approach for computing collision probabilities of arbitrary objects with arbitrary unimodal uncertainty distributions. Our approach relegates the computationally intensive estimation of collision probabilities via sampling at the training step, allowing for fast neural network inference of the constraints during planning. In extensive experiments, we show that Deep Collision Probability Fields can produce reasonably accurate collision probabilities (up to 10^{-3}) for planning and that our approach can be easily plugged into standard path planning approaches to plan safe paths on 2-D maps containing uncertain static and dynamic obstacles. Additional material, code, and videos are available at <a class="link-external link-https" href="https://sites.google.com/view/ral-dcpf" rel="external noopener nofollow">this https URL</a>.

Robotics,Artificial Intelligence
Safe deep learning-based global path planning using a fast collision-free path generator

Shirin Chehelgami,Erfan Ashtari,Mohammad Amin Basiri,Mehdi Tale Masouleh,Ahmad Kalhor

DOI: https://doi.org/10.1016/j.robot.2023.104384

IF: 3.7

2023-05-01

Robotics and Autonomous Systems

Abstract:In this research, a global path planning method based on recurrent neural networks by means of a new Loss function is presented, which regardless of the complexity of the configuration space, generates the path in a relatively constant time. The new Loss function is defined in such a way that in addition to learning the input data of the network, it creates an adjustable safety margin around the obstacles and ultimately creates a safe path. Moreover, a new global path planning method is also introduced, which is used to create the dataset required to train the proposed neural network. The convergence of this method is mathematically proven and it is shown that this method can also produce a suboptimal path in a much shorter time than the common methods of global path planning reported in the literature. In short, the main purpose of this research consists in providing a method which can create a suboptimal, fast and safe path for a mobile robot from any random starting point to any random destination in a known environment. First, the proposed methods will be implemented for different two-dimensional environments consisting of convex and non-convex obstacles, considering the robot as a point-mass, and then it will be implemented in a simulation environment, AI2THOR. Compared to classical global path planning algorithms, such as RRT and A*, the proposed approach demonstrates better performance in complex and challenging environments.

robotics,automation & control systems,computer science, artificial intelligence
Path Planning in Dynamic Environments through Trajectory Prediction and Reinforcement Learning

Lingyue Kong,Yuanda Wang,Jiacheng Yang

DOI: https://doi.org/10.1109/YAC59482.2023.10401636

2023-08-27

Abstract:Due to the presence of dynamic obstacles, like pedestrians and other mobile robots, on-line path planning for mobile robots in dynamic environments becomes challenging. Many traditional methods are based on off-line path planning, and replan a feasible path when dynamic obstacles appear. However, these methods often fail to plan a path in many cases due to robot deadlocks and oscillating movements. Many deep neural network-based approaches try to solve these problems by introducing learning-based techniques for dynamic environments. However, such models often cause detours because of the lack of the motion characteristics of dynamic obstacles. To address this issue, we propose a two-stage learning-based model. In the first stage, our model extracts surrounding environment features and dynamic characteristics of obstacles, and outputs predicted trajectories of obstacles. In the second stage, our model plans a feasible and efficient path for mobile robots by reinforcement learning and the predicted trajectories. We evaluate our method across different maps. The result shows that our model successfully completes planning in various dynamic environments, and shows outstanding predictability and processing capacity for dynamic obstacles.

Computer Science,Engineering
Hierarchical Control Framework for Path Planning of Mobile Robots in Dynamic Environments Through Global Guidance and Reinforcement Learning

Hongyang Zhao,Yanan Guo,Xingdong Li,Yi Liu,Jing Jin

DOI: https://doi.org/10.1109/jiot.2024.3459918

IF: 10.6

2024-01-01

IEEE Internet of Things Journal

Abstract:This paper focuses on achieving efficient and safe navigation for robots in dynamic and unpredictable environments. We propose a hierarchical path planning framework that integrates global path planning with local dynamic obstacle avoidance. This framework aims to quickly plan a collision-free, shortest, and safest path for the robot while adapting the navigation path according to uncertainties in the operating environment. Global path planning is conducted using the improved gray wolf optimization algorithm (IGWO), trajectory tracking is achieved through a pure pursuit control algorithm, and a dynamic switching mechanism based on deep reinforcement learning (DRL) significantly enhances the navigation performance of the robotic system. The effectiveness of this approach has been verified through simulations and experiments. Simulation results indicate that in global path planning, the IGWO algorithm achieves faster convergence compared to algorithms such as GWO-MP and GWO-CS. The planned path lengths are reduced by approximately 4.01% and 2.27%, respectively, and the fitness values are decreased by 4.78% and 1.9%, demonstrating superior path planning performance. For local dynamic obstacle avoidance, both single-robot and multi-robot systems successfully avoided obstacles in multiple experiments. Finally, physical experiments conducted in various complex scenarios show that both single-robot and multi-robot systems can effectively execute global planning and respond to unexpected obstacles. These results further demonstrate the method’s wide applicability and robust performance across diverse complex environments.
Guided deep reinforcement learning framework using automated curriculum scheme for accurate motion planning

Deun-Sol Cho,Jae-Min Cho,Won-Tae Kim

DOI: https://doi.org/10.1016/j.engappai.2024.109541

IF: 8

2024-11-13

Engineering Applications of Artificial Intelligence

Abstract:Collaborative robotic arms in smart factories should ensure the safety and interactivity during their operation such as reaching and grasping objects. Especially, the advanced motion planner including the path planning and the motion control functions is essential for human-machine co-working. Since the traditional physics-based motion planning approaches require extreme computational resources to obtain near-optimal solutions, deep reinforcement learning algorithms have been actively adopted and have effectively solved the limitation. They, however, have the easy task preference problem, primarily taking the simpler ways for the more rewards, due to randomly training the agents how to reach the target points in the large-scale search spaces. Therefore, we propose a novel curriculum-based deep reinforcement learning framework that makes the agents learn the motion planning tasks in unbiased ways from the ones with the low complexities to the others with the high complexities. It uses the unsupervised learning algorithms to cluster the target points with the similar task complexities for generating the effective curriculum. In addition, the review and buffer flushing mechanisms are integrated into the framework to mitigate the catastrophic forgetting problem where the agent abruptly lose the previous learned knowledge upon learning new one in the curriculum. The evaluation results of the proposed framework show that the curriculum significantly enhances the success rate on the task with the highest complexity from 12% to 56% and the mechanisms improve the success rate on the tasks with the easier complexities from an average of 66% to 76.5%, despite requiring less training time.

automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
A Safety-Critical Framework for UGVs in Complex Environments: A Data-Driven Discrepancy-Aware Approach

Skylar X. Wei,Lu Gan,Joel W. Burdick

2024-03-06

Abstract:This work presents a novel data-driven multi-layered planning and control framework for the safe navigation of a class of unmanned ground vehicles (UGVs) in the presence of unknown stationary obstacles and additive modeling uncertainties. The foundation of this framework is a novel robust model predictive planner, designed to generate optimal collision-free trajectories given an occupancy grid map, and a paired ancillary controller, augmented to provide robustness against model uncertainties extracted from learning data.

Robotics
An Adaptive Path Planning Approach for Digital Twin-Enabled Robot Arm Based on Inverse Kinematics and Deep Reinforcement Learning

Qi Zhou,Sikai Li,Jingbo Qu,Jin Wu,Haomiao Xu,Youyi Bi

DOI: https://doi.org/10.1115/imece2023-113131

2023-01-01

Abstract:Efficient path planning methods for robot arms are crucial to ensure the quality and safety of their completing various tasks. Compared to traditional manual instruction, Reinforcement Learning (RL) based path planning methods show better adaptability for complex working scenarios. However, the training of RL is usually time-consuming with limited success rate. To tackle this problem, we propose an adaptive path planning approach for robot arm based on Inverse Kinematics (IK) and Deep Reinforcement Learning (DRL) in a pick-and-place context. A judgement mechanism is developed to adaptively select IK or RL based method according to the results of early-stage collision detection. We separate the pick and place task into three sequential curriculums (approaching, grabbing and placing) with modified reward functions to speed up the training process and achieve a higher success rate. The proposed approach is validated with a physical robot arm supported by a high-fidelity digital twin model. The experiment results show that our proposed approach outperforms traditional RL based method with improved training speed and guaranteed performance in collision avoidance and path accuracy. This work contributes to the practical deployment of RL based path planning method for digital twin-enabled robot arm in smart manufacturing.
Scanning Path Planning of Ultrasonic Testing Robot Based on Deep Image Processing

Jianjun Zhao,Zhong Zhang,Minghui Zhang,Xiaozhong Du

DOI: https://doi.org/10.1134/S1061830922030020

2022-06-18

Russian Journal of Nondestructive Testing

Abstract:Aiming at the problems of long time consuming and low precision of manual teaching or off-line programming in scanning path planning of ultrasonic testing robot, a method of generating ultrasonic testing robot trajectory based on deep image processing was proposed. Firstly, the consumer-level depth camera is used to collect images on the surface of the measured object and repair the information missing in the depth image. Then the surface point cloud is generated by using the depth image and color image of the object to be measured, and the scanning path of the detection robot is generated by the method of point cloud normal vector estimation and curve fitting. Finally, the scanning path is verified by MATLAB and Coppeliasim co-simulation. The results show that the ultrasonic testing robot can move accurately along the extracted scanning path, and realize the automatic detection of micro defects in the workpiece, the detection scanning surface of the workpiece is a plane, which provides an experimental basis and theoretical basis for the subsequent research on the scanning path planning of the ultrasonic testing robot.

materials science, characterization & testing
A Method to Plan the Path of a Robot Utilizing Deep Reinforcement Learning and Multi-Sensory Information Fusion

Jieren Tan

DOI: https://doi.org/10.1080/08839514.2023.2224996

IF: 2.777

2023-06-25

Applied Artificial Intelligence

Abstract:Nowadays, mobile robots are being widely employed in various settings, including factories, homes, and everyday tasks. Achieving successful implementation of autonomous robot movement largely depends on effective route planning. Therefore, it is not surprising that there is a growing trend in studying and improving the intelligence of this technology. Deep reinforcement learning has shown remarkable performance in decision-making problems and can be effectively utilized to address path planning challenges faced by mobile robots. This manuscript focuses on investigating path planning problems using deep reinforcement learning and multi-sensing information fusion technology. The manuscript elaborates on the significance of path planning, providing comprehensive research encompassing path planning algorithms, deep reinforcement learning, and multi-sensing information fusion. Also, the fundamental theory of deep reinforcement learning is introduced, followed by the design of a multimodal perception module based on image and lidar. A semantic segmentation approach is employed to bridge the gap between simulated and real environments. To enhance strategy, a lightweight multimodal data fusion network model is carefully developed, incorporating modality separation learning. Overall, in this paper, we explore the use of a deep reinforcement learning architecture for conducting path planning experiments with mobile robots. The results obtained from these experiments demonstrate promising outcomes.

computer science, artificial intelligence,engineering, electrical & electronic
Addressing unpredictable movements of dynamic obstacles with deep reinforcement learning to ensure safe navigation for omni-wheeled mobile robot

Saurabh Sachan,Pushparaj Mani Pathak

DOI: https://doi.org/10.1177/09544062241281115

2024-10-08

Proceedings of the Institution of Mechanical Engineers Part C Journal of Mechanical Engineering Science

Abstract:Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science, Ahead of Print. The safe and efficient navigation of mobile robots in the presence of unknown dynamic obstacles remains a complex and unresolved challenge. This paper presents collision-free path planning for a mobile robot that safely deals with multi-directional obstacles, that is, randomly moving dynamic obstacles, using a Deep Reinforcement Learning (DRL) algorithm named Deep Q-Network (DQN) with inflated robot reward functions. The robot moves in a time-efficient and collision-free route while maintaining a safe distance with both static and unpredictable dynamic obstacles. The modified DQN algorithm takes RGB images of the environment as input for training a Convolution Neural Network (CNN) and provides a safe and short path for navigation. The robot used for training is an omni-wheeled mobile robot exploring outdoors, that is, concourse environment, and indoors, that is, home environment. The Closed-Loop Inverse Kinematics (CLIK) algorithm is employed to control a mobile robot to follow the desired path. The simulation results indicate that the proposed algorithm with inflated robot reward functions demonstrates remarkable performance as compared to recently used Reinforcement Learning (RL) algorithms when dealing with both stationary and randomly moving obstacles in the given environment.

engineering, mechanical
Efficient Collision Detection Framework for Enhancing Collision-Free Robot Motion

Xiankun Zhu,Yucheng Xin,Shoujie Li,Houde Liu,Chongkun Xia,Bin Liang

2024-09-23

Abstract:Fast and efficient collision detection is essential for motion generation in robotics. In this paper, we propose an efficient collision detection framework based on the Signed Distance Field (SDF) of robots, seamlessly integrated with a self-collision detection module. Firstly, we decompose the robot's SDF using forward kinematics and leverage multiple extremely lightweight networks in parallel to efficiently approximate the SDF. Moreover, we introduce support vector machines to integrate the self-collision detection module into the framework, which we refer to as the SDF-SC framework. Using statistical features, our approach unifies the representation of collision distance for both SDF and self-collision detection. During this process, we maintain and utilize the differentiable properties of the framework to optimize collision-free robot trajectories. Finally, we develop a reactive motion controller based on our framework, enabling real-time avoidance of multiple dynamic obstacles. While maintaining high accuracy, our framework achieves inference speeds up to five times faster than previous methods. Experimental results on the Franka robotic arm demonstrate the effectiveness of our approach.

Robotics
CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generation

Adithyavairavan Murali,Arsalan Mousavian,Clemens Eppner,Adam Fishman,Dieter Fox

DOI: https://doi.org/10.48550/arXiv.2304.09302

IF: 3.7

2023-04-18

Robotics

Abstract:We address the important problem of generalizing robotic rearrangement to clutter without any explicit object models. We first generate over 650K cluttered scenes - orders of magnitude more than prior work - in diverse everyday environments, such as cabinets and shelves. We render synthetic partial point clouds from this data and use it to train our CabiNet model architecture. CabiNet is a collision model that accepts object and scene point clouds, captured from a single-view depth observation, and predicts collisions for SE(3) object poses in the scene. Our representation has a fast inference speed of 7 microseconds per query with nearly 20% higher performance than baseline approaches in challenging environments. We use this collision model in conjunction with a Model Predictive Path Integral (MPPI) planner to generate collision-free trajectories for picking and placing in clutter. CabiNet also predicts waypoints, computed from the scene's signed distance field (SDF), that allows the robot to navigate tight spaces during rearrangement. This improves rearrangement performance by nearly 35% compared to baselines. We systematically evaluate our approach, procedurally generate simulated experiments, and demonstrate that our approach directly transfers to the real world, despite training exclusively in simulation. Robot experiment demos in completely unknown scenes and objects can be found at this http https://cabinet-object-rearrangement.github.io
Collision-free path planning for a guava-harvesting robot based on recurrent deep reinforcement learning

Guichao Lin,Lixue Zhu,Jinhui Li,Xiangjun Zou,Yunchao Tang

DOI: https://doi.org/10.1016/j.compag.2021.106350

IF: 8.3

2021-09-01

Computers and Electronics in Agriculture

Abstract:In unstructured orchard environments, picking a target fruit without colliding with neighboring branches is a significant challenge for guava-harvesting robots. This paper introduces a fast and robust collision-free path-planning method based on deep reinforcement learning. A recurrent neural network is first adopted to remember and exploit the past states observed by the robot, then a deep deterministic policy gradient algorithm (DDPG) predicts a collision-free path from the states. A simulation environment is developed and its parameters are randomized during the training phase to enable recurrent DDPG to generalize to real-world scenarios. We also introduce an image processing method that uses a deep neural network to detect obstacles and uses many three-dimensional line segments to approximate the obstacles. Simulations show that recurrent DDPG only needs 29 ms to plan a collision-free path with a success rate of 90.90%. Field tests show that recurrent DDPG can increase grasp, detachment, and harvest success rates by 19.43%, 9.11%, and 10.97%, respectively, compared to cases where no collision-free path-planning algorithm is implemented. Recurrent DDPG strikes a strong balance between efficiency and robustness and may be suitable for other fruits.

agriculture, multidisciplinary,computer science, interdisciplinary applications
DBPF: A Framework for Efficient and Robust Dynamic Bin-Picking

Yichuan Li,Junkai Zhao,Yixiao Li,Zheng Wu,Rui Cao,Masayoshi Tomizuka,Yunhui Liu

DOI: https://doi.org/10.1109/LRA.2024.3387145

2024-03-25

Abstract:Efficiency and reliability are critical in robotic bin-picking as they directly impact the productivity of automated industrial processes. However, traditional approaches, demanding static objects and fixed collisions, lead to deployment limitations, operational inefficiencies, and process unreliability. This paper introduces a Dynamic Bin-Picking Framework (DBPF) that challenges traditional static assumptions. The DBPF endows the robot with the reactivity to pick multiple moving arbitrary objects while avoiding dynamic obstacles, such as the moving bin. Combined with scene-level pose generation, the proposed pose selection metric leverages the Tendency-Aware Manipulability Network optimizing suction pose determination. Heuristic task-specific designs like velocity-matching, dynamic obstacle avoidance, and the resight policy, enhance the picking success rate and reliability. Empirical experiments demonstrate the importance of these components. Our method achieves an average 84% success rate, surpassing the 60% of the most comparable baseline, crucially, with zero collisions. Further evaluations under diverse dynamic scenarios showcase DBPF's robust performance in dynamic bin-picking. Results suggest that our framework offers a promising solution for efficient and reliable robotic bin-picking under dynamics.

Robotics,Systems and Control
Sensor-based Complete Coverage Path Planning in Dynamic Environment for Cleaning Robot

Hong Liu,Jiayao Ma,Weibo Huang

DOI: https://doi.org/10.1049/trit.2018.0009

IF: 7.985

2018-01-01

CAAI Transactions on Intelligence Technology

Abstract:Using Complete Coverage Path Planning ( CCPP), a cleaning robot could visit every accessible area in the workspace. The dynamic environment requires the higher computation of the CCPP algorithm because the path needs to be replanned when the path might become invalid. In previous CCPP methods, when the neighbours of the current position are obstacles or have been visited, it is challenging for the robot to escape from the deadlocks with the least extra time cost. In this study, a novel CCPP algorithm is proposed to deal with deadlock problems in a dynamic environment. A priority template inspired by the short memory model could reduce the number of deadlocks by giving the priority of directions. Simultaneously, a global backtracking mechanism guides the robot to move to the next unvisited area quickly, taking the use of the explored global environmental information. What's more, the authors extend their CCPP algorithm to a multi- robot system with a market- based bidding process which could deploy the coverage time. Experiments of apartment-like scenes show that the authors' proposed algorithm can guarantee an efficient collision-free coverage in dynamic environments. The proposed method performs better than related approaches on coverage rate and overlap length.

End-to-end deep learning-based framework for path planning and collision checking: bin-picking application – ERRATUM

End-to-end deep learning-based framework for path planning and collision checking: bin picking application

End-to-end deep learning-based framework for path planning and collision checking: bin-picking application

Optimization-based Motion Planning for Autonomous Parking Considering Dynamic Obstacle: A Hierarchical Framework

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

Automatic Object Searching and Behavior Learning for Mobile Robots in Unstructured Environment by Deep Belief Networks.

Safe and Efficient Path Planning under Uncertainty via Deep Collision Probability Fields

Safe deep learning-based global path planning using a fast collision-free path generator

Path Planning in Dynamic Environments through Trajectory Prediction and Reinforcement Learning

Hierarchical Control Framework for Path Planning of Mobile Robots in Dynamic Environments Through Global Guidance and Reinforcement Learning

Guided deep reinforcement learning framework using automated curriculum scheme for accurate motion planning

A Safety-Critical Framework for UGVs in Complex Environments: A Data-Driven Discrepancy-Aware Approach

An Adaptive Path Planning Approach for Digital Twin-Enabled Robot Arm Based on Inverse Kinematics and Deep Reinforcement Learning

Scanning Path Planning of Ultrasonic Testing Robot Based on Deep Image Processing

A Method to Plan the Path of a Robot Utilizing Deep Reinforcement Learning and Multi-Sensory Information Fusion

Addressing unpredictable movements of dynamic obstacles with deep reinforcement learning to ensure safe navigation for omni-wheeled mobile robot

Efficient Collision Detection Framework for Enhancing Collision-Free Robot Motion

CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generation

Collision-free path planning for a guava-harvesting robot based on recurrent deep reinforcement learning

DBPF: A Framework for Efficient and Robust Dynamic Bin-Picking

Sensor-based Complete Coverage Path Planning in Dynamic Environment for Cleaning Robot