Abstract:Convolutional neural networks (CNNs) have been widely used for object recognition and grasping posture planning in intelligent robotic grasping (IRG). Compared with the traditional usage of CNNs in image recognition, IRGs require high recognition accuracy and computational efficiency. However, the existing methodologies for CNN architecture design often rely on human experience and numerous trial-and-error attempts, which make it a very challenging task to obtain an optimal CNN for IRGs. To tackle this challenge, this paper develops a new differentiable architecture search (DARTS) method considering the floating-point operations (FLOPs) of CNNs, named the DARTS-F method, which converts the discrete CNN architecture search to a gradient-based continuous optimization problem and considers both the prediction accuracy and the computational cost of the CNN during the optimization. To efficiently identify the optimal neural network, this paper adopts a bilevel optimization, which first trains the neural network weights in the inner level and then optimizes the neural network architecture by fine-tuning the operational variables in the outer level. In addition, a new digital twin (DT) of IRG is developed considering the physics of realistic robotic grasping in the DT’s virtual space, which could not only improve the IRG accuracy but also avoid the expensive training time. In the experiments, the proposed DARTS-F method could generate an optimized CNN with higher prediction accuracy and lower FLOPs than those obtained by the original DARTS method. The DT framework improves the accuracy of real robotic grasping from 61 to 71%.

CASOG: Conservative Actor–Critic With SmOoth Gradient for Skill Learning in Robot-Assisted Intervention

CASOG: Conservative Actor-critic with SmOoth Gradient for Skill Learning in Robot-Assisted Intervention

Collaborative Robot-Assisted Endovascular Catheterization with Generative Adversarial Imitation Learning

Machine Learning-Based Surgical State Perception and Collaborative Control for a Vascular Interventional Robot

Trajectory Optimization of Robot-Assisted Endovascular Catheterization with Reinforcement Learning

A new differentiable architecture search method for optimizing convolutional neural networks in the digital twin of intelligent robotic grasping

Improved Genetic Algorithm Based on Greedy and Simulated Annealing Ideas for Vascular Robot Ordering Strategy

Learning-based Endovascular Navigation Through the Use of Non-Rigid Registration for Collaborative Robotic Catheterization

Reinforcement Learning Based Manipulation Skill Transferring for Robot-assisted Minimally Invasive Surgery.

A novel robotic system for vascular intervention: principles, performances, and applications

A vascular interventional surgical robot based on surgeon’s operating skills

A Generalized Predictive Control for Remote Cardiovascular Surgical Systems

A Deep-Learning-Based Guidewire Compliant Control Method for the Endovascular Surgery Robot

Adaptive Semi-Supervised Intent Inferral to Control a Powered Hand Orthosis for Stroke

Study on Autonomous Delivery of Guidewire Based on Improved YOLOV5s on Vascular Model Platform

Autonomous Tissue Manipulation via Surgical Robot Using Learning Based Model Predictive Control

A PSO-Optimized Fuzzy Reinforcement Learning Method for Making the Minimally Invasive Surgical Arm Cleverer.

TCN-Based Distal Force Feedback Strategy of a Vascular Interventional Surgery Robot

Learning Skill Characteristics From Manipulations

A Remote-Controlled Robotic System with Safety Protection Strategy Based on Force-Sensing and Bending Feedback for Transcatheter Arterial Chemoembolization

Haptic Feedback and Dynamic Active Constraints for Robot-Assisted Endovascular Catheterization