Abstract:Introduction: Remote military operations require rapid response times for effective relief and critical care. Yet, the military theater is under austere conditions, so communication links are unreliable and subject to physical and virtual attacks and degradation at unpredictable times. Immediate medical care at these austere locations requires semi-autonomous teleoperated systems, which enable the completion of medical procedures even under interrupted networks while isolating the medics from the dangers of the battlefield. However, to achieve autonomy for complex surgical and critical care procedures, robots require extensive programming or massive libraries of surgical skill demonstrations to learn effective policies using machine learning algorithms. Although such datasets are achievable for simple tasks, providing a large number of demonstrations for surgical maneuvers is not practical. This article presents a method for learning from demonstration, combining knowledge from demonstrations to eliminate reward shaping in reinforcement learning (RL). In addition to reducing the data required for training, the self-supervised nature of RL, in conjunction with expert knowledge-driven rewards, produces more generalizable policies tolerant to dynamic environment changes. A multimodal representation for interaction enables learning complex contact-rich surgical maneuvers. The effectiveness of the approach is shown using the cricothyroidotomy task, as it is a standard procedure seen in critical care to open the airway. In addition, we also provide a method for segmenting the teleoperator's demonstration into subtasks and classifying the subtasks using sequence modeling. Materials and methods: A database of demonstrations for the cricothyroidotomy task was collected, comprising six fundamental maneuvers referred to as surgemes. The dataset was collected by teleoperating a collaborative robotic platform-SuperBaxter, with modified surgical grippers. Then, two learning models are developed for processing the dataset-one for automatic segmentation of the task demonstrations into a sequence of surgemes and the second for classifying each segment into labeled surgemes. Finally, a multimodal off-policy RL with rewards learned from demonstrations was developed to learn the surgeme execution from these demonstrations. Results: The task segmentation model has an accuracy of 98.2%. The surgeme classification model using the proposed interaction features achieved a classification accuracy of 96.25% averaged across all surgemes compared to 87.08% without these features and 85.4% using a support vector machine classifier. Finally, the robot execution achieved a task success rate of 93.5% compared to baselines of behavioral cloning (78.3%) and a twin-delayed deep deterministic policy gradient with shaped rewards (82.6%). Conclusions: Results indicate that the proposed interaction features for the segmentation and classification of surgical tasks improve classification accuracy. The proposed method for learning surgemes from demonstrations exceeds popular methods for skill learning. The effectiveness of the proposed approach demonstrates the potential for future remote telemedicine on battlefields.

Decision-Making by the Autonomous Symbiotic Self-Relocating Massage Robot “Triangel” Based on SEMS After the Fall of Patient on Surface

A Symbiotic Self-Moving Massage Robot as a Wearable Monitoring and Decision-Making System

Design and Development of A Mobile-based System for Supporting Emergency Triage Decision Making

User-Interactive Robot Skin with Large-Area Scalability for Safer and Natural Human-Robot Collaboration in Future Telehealthcare

A Digital Twin Based Large-Area Robot Skin System for Safer Human-Centered Healthcare Robots Toward Healthcare 4.0

SYMBIOTIC SELF-RELOCATING MASSAGE ROBOT "OCTAHEDRAL DODECAPOD": CONCEPT AND LIKELIHOOD OF USE ON A PILOTED SPACE STATION

IoT-Enabled Robot Skin System for Enhancement of Safe Human-Robot Interaction

A Self-Adaptive IoT-based Approach for Improving the Decision Making of Active Surgical Robots in Hospitals

A Data-Driven Investigation on Surface Electromyography Based Clinical Assessment in Chronic Stroke

Controlling a Nursing Robot Based on sEMG Signal

Research on the method of identifying upper and lower limb coordinated movement intentions based on surface EMG signals

ASAP-CORPS: A Semi-Autonomous Platform for COntact-Rich Precision Surgery

A Home-based Tele-rehabilitation System With Enhanced Therapist-patient Remote Interaction: A Feasibility Study

Remote Monitoring, AI, Machine Learning and Mobile Ultrasound Integration upon 5G Internet in the Prehospital Care to Support the Golden Hour Principle and Optimize Outcomes in Severe Trauma and Emergency Surgery

Flexible physiotherapy massage robot

Physical relief potential through robot-assisted mobilization in nursing care: an exploratory study

Finding Biomechanically Safe Trajectories for Robot Manipulation of the Human Body in a Search and Rescue Scenario

Risk-Aware Decision Making in Service Robots to Minimize Risk of Patient Falls in Hospitals

Analysis of Comfort during Transfer by a Dual-Arm Care Robot Based on Human Body Pressure and Surface Electromyographic Signals

A wearable system to assist impaired-neck patients: Design and evaluation

Smart Health Software to Support Rescue Personnel in Emergency Situations