Abstract:Purpose: Minimally invasive surgery (MIS) has become the standard for many surgical procedures as it minimizes trauma, reduces infection rates and shortens hospitalization. However, the manipulation of objects in the surgical workspace can be difficult due to the unintuitive handling of instruments and limited range of motion. Apart from the advantages of robot-assisted systems such as augmented view or improved dexterity, both robotic and MIS techniques introduce drawbacks such as limited haptic perception and their major reliance on visual perception. Methods: In order to address the above-mentioned limitations, a perception study was conducted to investigate whether the transmission of intra-abdominal acoustic signals can potentially improve the perception during MIS. To investigate whether these acoustic signals can be used as a basis for further automated analysis, a large audio data set capturing the application of electrosurgery on different types of porcine tissue was acquired. A sliding window technique was applied to compute log-mel-spectrograms, which were fed to a pre-trained convolutional neural network for feature extraction. A fully connected layer was trained on the intermediate feature representation to classify instrument-tissue interaction. Results: The perception study revealed that acoustic feedback has potential to improve the perception during MIS and to serve as a basis for further automated analysis. The proposed classification pipeline yielded excellent performance for four types of instrument-tissue interaction (muscle, fascia, liver and fatty tissue) and achieved top-1 accuracies of up to 89.9%. Moreover, our model is able to distinguish electrosurgical operation modes with an overall classification accuracy of 86.40%. Conclusion: Our proof-of-principle indicates great application potential for guidance systems in MIS, such as controlled tissue resection. Supported by a pilot perception study with surgeons, we believe that utilizing audio signals as an additional information channel has great potential to improve the surgical performance and to partly compensate the loss of haptic feedback.

Integrating the MasSpec Pen to the da Vinci Surgical System for In Vivo Tissue Analysis during a Robotic Assisted Porcine Surgery

Rapid diagnosis and tumor margin assessment during pancreatic cancer surgery with the MasSpec Pen technology

Experimental Analysis of Robot-Assisted Needle Insertion into Porcine Liver

Robot-assisted Transvaginal Peritoneoscopy Using Confocal Endomicroscopy: a Feasibility Study in a Porcine Model.

Enhancing Veress Needle Entry with Proximal Vibroacoustic Sensing for Automatic Identification of Peritoneum Puncture

ALL-IN-ONE Snare for Hybrid Endoscopic Submucosal Dissection Versus Conventional Technology: A Matched Study in Porcine Model (with Video)

A Novel Surface-Scanning Device for Intraoperative Tumor Identification and Therapy

Enhancing Intraoperative Tissue Identification: Investigating a Smart Electrosurgical Knife's Functionality During Electrosurgery

Laser Ablation Electrospray Ionization Time-of-Flight Mass Spectrometry for Direct Analysis of Biological Tissue

A Miniaturised Robotic Probe for Real-Time Intraoperative Fusion of Ultrasound and Endomicroscopy.

Data Acquisition and Intraoperative Tissue Analysis on a Mobile, Battery-Operated, Orbitrap Mass Spectrometer

A miniaturized robotic platform for natural orifice transluminal endoscopic surgery: in vivo validation

A Minimally Invasive Robotic Tissue Palpation Device

Acoustic signal analysis of instrument-tissue interaction for minimally invasive interventions

Intraoperative laparoscopic photoacoustic image guidance system in the da Vinci surgical system

Minimally Invasive Beaded Electrosurgical Dissectors, Basic Science, and Pilot Studies

Assessment of novel endoscopic multi-functional snare for endoscopic resection in porcine model in vivo and in vitro

Human robotic surgery with intraoperative tissue identification using rapid evaporation ionisation mass spectrometry

Breaking Barriers in Robotic Soft Tissue Surgery: Conditional Autonomous Intestinal Anastomosis

Dense 3D Reconstruction Through Lidar: A Comparative Study on Ex-vivo Porcine Tissue

Trans-umbilical endoscopic cholecystectomy with a water-jet hybrid-knife: a pilot animal study.