A force-sensor improves trainee technique for rigid endoscopy

Sumrit Bola,Manu Kunaal Shrivastava,Josh Brown,Matthew Cherko,Beatrice Emmanouil

DOI: https://doi.org/10.1017/s0022215124000057

2024-01-18

The Journal of Laryngology & Otology

Abstract://static.cambridge.org/content/id/urn%3Acambridge.org%3Aid%3Aarticle%3AS0022215124000057/resource/name/firstPage-pdf-S0022215124000057a.jpg

otorhinolaryngology

What problem does this paper attempt to address?

Force sensing in robot-assisted keyhole endoscopy: A systematic survey

Amir Hossein Hadi Hosseinabadi,Septimiu E. Salcudean

DOI: https://doi.org/10.1177/02783649211052067

2021-11-16

The International Journal of Robotics Research

Abstract:Instrument–tissue interaction forces in minimally invasive surgery (MIS) provide valuable information that can be used to provide haptic perception, monitor tissue trauma, develop training guidelines, and evaluate the skill level of novice and expert surgeons. Force and tactile sensing is lost in many robot-assisted surgery (RAS) systems. Therefore, many researchers have focused on recovering this information through sensing systems and estimation algorithms. This article provides a comprehensive systematic review of the current force sensing research aimed at RAS and, more generally, keyhole endoscopy, in which instruments enter the body through small incisions. Articles published between January 2011 and May 2020 are considered, following the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines. The literature search resulted in 110 papers on different force estimation algorithms and sensing technologies, sensor design specifications, and fabrication techniques.
Endoscope Force Generation and Intrinsic Sensing with Environmental Scaffolding

Julius E. Bernth,Junghwan Back,George Abrahams,Lukas Lindenroth,Bu Hayee,Hongbin Liu

DOI: https://doi.org/10.1109/icra.2019.8793726

2019-05-01

Abstract:Endoscopic surgery is an increasingly popular alternative to laparoscopic techniques for many conditions, as the operation site can be reached without skin wounds. In many tasks, sufficient force generation is desired. As endoscopes must be highly flexible and slim, however, the force generation and sensing capabilities associated with these tools is limited due their compliance, significantly hindering the adoption rate of endoscopic surgeries. This paper proposes a technique, termed ‘environmental scaffolding’, to stabilize an actuated, flexible segment in the intestine such that larger forces can be applied. Through the measurement of actuation forces, a method for intrinsically sensing multiple contact forces when in this configuration is presented. Experimental results show that with the environmental scaffolding technique, the tip force generated can be increased by over 50% on average compared to using the device in a purely cantilevered configuration, and the tip force estimation is accurate to within 2.97%.
A Prospective Study on a Suture Force Feedback Device for Training and Evaluating Junior Surgeons in Anastomotic Surgical Closure

S. Dinesh,S. Poonguzhali,M. Satish Devakumar,S. Jeswanth

DOI: https://doi.org/10.1177/15533506241264382

2024-06-22

Surgical Innovation

Abstract:Surgical Innovation, Ahead of Print. BackgroundSurgical reconstruction is a crucial stage in various surgeries, including pancreaticoduodenectomy, as it can significantly affect the surgical results. The objective was to design a suture force feedback (SFF) device that can precisely measure the suture force during surgical closures. Afterward, the device was used to train junior surgeons in surgical closure techniques.MethodsThe SFF was used to capture the suture force data of experienced surgeons. This data was utilized to train and assess junior surgeons. The SFF device had 2 tactile-based force sensors that measured the applied force. Whenever the applied force was not within the optimal force range, the device provided feedback to the surgeon. A workshop was conducted to train junior surgeons in surgical closure techniques to improve their suturing skills.ResultsThirty-seven junior surgeons were enrolled in this training, of whom only 24 completed the 30-day training program. The pre-assessment results revealed that the force exerted by junior surgeons during suture knot-tying was uneven compared with that of the experienced surgeons, with a significant difference in the force exerted per knot throw (P = 0.005. Before the training program, junior surgeons applied a force of 3.89 ± 0.43 N, which was more than twice the force applied by experienced surgeons (1.75 ± 0.12 N). However, after completing the 30-day training program, their force improved to 2.35 ± 0.13 N.ConclusionsThe SFF device was shown to be an encouraging training tool for improving the surgical closure dexterity and technique of the participating junior surgeons.

surgery
An EM-Tracked Approach for Calibrating the 3D Pose of Flexible Endoscopes

Zhongjie Long,Yongting Chi,Xianbo Zhang,Hongbing Li,Dejin Yang,Diangeng Li,Zhouxiang Jiang

DOI: https://doi.org/10.1007/s10439-024-03469-1

Abstract:Flexible endoscopes are ideal instruments for visualizing and diagnosing the inner surfaces of organs via a minimally invasive incision. Calibrating a flexible endoscope is a troublesome yet inevitable process in image-based tools tracking. Aiming to simplify the calibration process, we propose an electromagnetic (EM)-tracked calibration approach that does not require any predefined poses of the EM sensor. A three-stage calibration protocol was presented in an extensor. First, the orientation of the endoscope tube was derived by conducting a circular rotation of the endoscope around its axis utilizing a pair of tightly bearing stands. Second, the 3D position of the endoscope tip was acquired by having the tip come into contact with a flat plane. Third, the pose model of the bending section was derived and transformed into the local coordinate system of the EM sensor attached to the endoscope handle. To assess the accuracy of the proposed calibration approach, two experiments were designed and performed. Experimental results indicate accuracies of 0.09 ± 0.06 deg and 0.03 ± 0.19 deg in the estimation of the endoscope tube orientation and 0.52 ± 0.29, 0.33 ± 0.11, and 0.29 ± 0.17 mm in the x, y, and z estimations of the endoscope tip position, respectively. The proposed approach is accurate and easy to operate, does not require the employment of custom calibration markers, and can be used not only in surgical training systems but also in the endoscopic-based tools tracking.
Colonic displacement as a marker of endoscopic skill: development of a novel tool for endoscopy training

Jeffrey D. E. Hawel,Rajni Patel,Terry Peters,Kerollos Wanis,Anish Naidu,Ran Xu,Ahmad I. Elnahas,Nawar A. Alkhamesi,Christopher M. Schlachta

DOI: https://doi.org/10.1007/s00464-021-08620-w

2021-07-06

Surgical Endoscopy

Abstract:<span class="a-plus-plus abstract-section id-a-sec1"><h3 class="a-plus-plus">Background</h3><p class="a-plus-plus">Colonoscopy is a technically challenging procedure. The colonoscope is prone to forming loops in the colon, which can lead patient discomfort and even perforation. We hypothesized that expert endoscopists use techniques to avoid loop formation, identify and straighten loops earlier, and thus exert less force.</p></span><span class="a-plus-plus abstract-section id-a-sec2"><h3 class="a-plus-plus">Methods</h3><p class="a-plus-plus">Using a commercially available physical colon simulator model (Kyoto Kagaku), electromagnetic tracking markers (NDI Medical) were placed along the mobile segments of the colon (sigmoid, transverse) to measure the degree of displacement of the colon as the scope was advanced to the cecum. The colon model was set for each participant to simulate a redundant alpha loop in the sigmoid colon. Gastroenterology and surgical trainees and attendings were assessed. Demographic data were collected for each participant.</p></span><span class="a-plus-plus abstract-section id-a-sec3"><h3 class="a-plus-plus">Results</h3><p class="a-plus-plus">Seventy-five participants were enrolled in the study. There were 17 (22.7%) attending physicians, and 58 (77.3%) trainees. Attending physicians advanced the scope to the cecum faster. The mean time required for procedure completion was 360.5 s compared to 178.4 s for the trainee and attending groups respectively (mean difference: 182.1 s, 95% CI: 93.0, 269.7; <em class="a-plus-plus">p</em> = 0.0002). Attending physicians exerted significantly lower mean colonic displacement than trainees. The mean colonic displacement was 79.8 mm for the trainee group and 57.9 mm for the attending group (mean difference: 21.9 mm, 95% CI: 2.6, 41.2; <em class="a-plus-plus">p</em> = 0.04). Those who used torque steering caused lower maximum colonic displacement than those who used knob steering.</p></span><span class="a-plus-plus abstract-section id-a-sec4"><h3 class="a-plus-plus">Conclusion</h3><p class="a-plus-plus">Attending physicians advance the scope during colonoscopy in a manner that results in significantly less colonic displacement than resident trainees. Although prior studies have shown a difference in force application between endoscopists and inexperienced students, ours is the first to differentiate across varying degrees of endoscopic skill. Future studies will define metrics for incorporation into endoscopic training curricula, focusing on techniques that encourage safety and comfort for patients.</p></span>
A Sensor-less Catheter Contact Force Estimation Approach in Endovascular Intervention Procedures

Masoud Razban,Javad Dargahi,Benoit Boulet

DOI: https://doi.org/10.1109/iros.2018.8593387

2018-10-01

Abstract:Catheter/guidewire manipulation in endovascu-lar intervention procedures are associated with risks of injury on vessel wall and embolization. Determination of catheter/guidewire-vessel interaction contact forces can improve the navigation process safety and efficiency which prevent injuries in both manual and robotic vascular interventions. This study proposes a sensor-less sensing solution to estimate multiple contact point forces at the side of catheter/guidewire exerted on the vasculature. This goal is achieved by using image feedback of catheter-vessel interaction and numerical finite element modeling (FEM). Real-time image processing algorithms are implemented to track interaction contact points on catheter/guidewire. Image-based deflection measurement and contact points tracking data are given to a nonlinear finite element beam model to estimate the forces. The variable equivalent bending modulus of the guidewire is found through a series of three-point-bending tests. To directly measure contact point forces, an experimental platform is prepared which simulates catheter/guidewire-vessel interaction with two, three and four contact points. The effectiveness of the proposed approach is tested in six scenarios in which force estimation accuracy of more than 87.9% is achieved. The proposed approach can be applied to various types of under-actuated catheter/guidewire in endovascular intervention procedures. This study proves that multiple catheter/guidewire side contact forces can be estimated by using the deflected shape and equivalent bending modulus property without embedding any force sensor.
FBG-Based Sensorized Surgical Instrument for Force Measurement in Minimally Invasive Robotic Surgery

Qiao Liu,Yu Dai,Mengwen Li,Bin Yao,Jianxun Zhang

DOI: https://doi.org/10.1109/jsen.2024.3365800

IF: 4.3

2024-01-01

IEEE Sensors Journal

Abstract:To address the lack of force measurement in minimally invasive robotic surgery, this article develops the sensorized surgical instrument based on fiber Bragg grating (FBG) technology. The sensorized surgical instrument detects forces in two directions by affixing three FBGs at 120° intervals on the shaft of the surgical instrument. For the designed sensorized surgical instrument, first, finite-element simulation is used to explore the impact of the trocar on the strain at the adhesive points of FBGs in the operation state. Subsequently, the study theoretically analyzes how the fixed position of the instrument on the calibration platform affects the strain. Furthermore, finite-element simulation is used to compare strain differences between the calibration state and the operation state. Finally, the static calibration experiment establishes the decoupling matrix for the instrument and demonstrates that changing its fixed position on the calibration platform yields a maximum force measurement error of 0.92%. Additionally, the accuracy of sensorized surgical instrument force measurement is demonstrated by hanging a weight from the end of the instrument and its surgical efficacy is proven in tumor localization tasks.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
Advancing Robotic Surgery: Affordable Kinesthetic and Tactile Feedback Solutions for Endotrainers

Bharath Rajiv Nair,Aravinthkumar T.,B. Vinod

2024-06-26

Abstract:The proliferation of robot-assisted minimally invasive surgery highlights the need for advanced training tools such as cost-effective robotic endotrainers. Current surgical robots often lack haptic feedback, which is crucial for providing surgeons with a real-time sense of touch. This absence can impact the surgeon's ability to perform delicate operations effectively. To enhance surgical training and address this deficiency, we have integrated a cost-effective haptic feedback system into a robotic endotrainer. This system incorporates both kinesthetic (force) and tactile feedback, improving the fidelity of surgical simulations and enabling more precise control during operations. Our system incorporates an innovative, cost-effective Force/Torque sensor utilizing optoelectronic technology, specifically designed to accurately detect forces and moments exerted on surgical tools with a 95% accuracy, providing essential kinesthetic feedback. Additionally, we implemented a tactile feedback mechanism that informs the surgeon of the gripping forces between the tool's tip and the tissue. This dual feedback system enhances the fidelity of training simulations and the execution of robotic surgeries, promoting broader adoption and safer practices.

Robotics
Triaxial Catheter-Tip Force Sensor for MRI-Guided Cardiac Procedures

Panagiotis Polygerinos,Lakmal D. Seneviratne,Reza Razavi,Tobias Schaeffter,Kaspar Althoefer

DOI: https://doi.org/10.1109/tmech.2011.2181405

2013-02-01

IEEE/ASME Transactions on Mechatronics

Abstract:This paper presents the development and evaluation of a miniature, three-axis, fiber-optic force sensor. the sensor is manufactured using low-cost, high-resolution rapid prototyping techniques and is integrated with a catheter to enable the detection of force during MRI-guided cardiac ablation procedures. the working principle is based on reflective light-intensity modulation. A force sensitive structure (flexure) is employed to vary the distance and orientation of an integrated reflector when a force is applied at the catheter tip. in this way, the light is modulated accordingly and the force can be calculated. the sensor has a high sensitivity and an adequate linear response along all three orthogonal axes $(F_{x}, F_{y}$, and $F_{z})$ and a working range of around 0.5 N. Low-noise, high-gain electronics provide a force resolution of less than 1 gm force. Experiments demonstrate the ability of the sensor to acquire accurate force readings in a dynamic environment. MRI-compatibility experiments are performed in a clinical 1.5-T MR scanner.
A Micro‐3‐Degree‐of‐Freedom Force Sensor for Intraocular Dexterous Surgical Robots

He Zhang,Chunbo Wang,Ming Bai,Haoran Yi,Jiahui Yang,Yanhe Zhu,Jie Zhao

DOI: https://doi.org/10.1002/aisy.202200413

IF: 7.298

2023-04-09

Advanced Intelligent Systems

Abstract:A micro‐3‐DOF force sensor is integrated into an intraocular flexible manipulator, in order to ensure that the needle insertion angle is adjustable and that the puncture force is effectively sensed. The proposed sensor exhibits outstanding comprehensive performances of miniaturized structure and high resolution. It can effectively detect the puncture force and improve the success rate of retinal vein cannulation. The continuum manipulator improves the intraocular robot flexibility during retinal surgery. Herein, a micro‐3‐degree of freedom (DOF) force sensor with a length of only 3.8 mm that can adjust the puncture angle during retinal vein cannulation (RVC) is proposed. Taking advantage of 3D printing technology, the optical fiber and injection line are embedded in the nitinol tube with flexible hinges to achieve integration of the force sensing and injection functions. A new fiber Bragg grating (FBG) configuration method and linear decoupling algorithm are also proposed herein. Static calibration experiments demonstrate excellent resolution of the force sensor, of less than 0.072 mN for transverse force and 0.738 mN for the axial force in the range from −20 to 20 mN. The proposed sensor is installed on a newly developed actuator, and an ex vivo experiment is performed on pig cadaver eyes. The interaction forces at each stage of the RVC are recorded in detail for the first time, further confirming the feasibility and effectiveness of the developed sensor for monitoring the RVC interaction forces.
FBG-Based Triaxial Force Sensor Integrated with an Eccentrically Configured Imaging Probe for Endoluminal Optical Biopsy

Zicong Wu,Anzhu Gao,Ning Liu,Zhu Jin,Guang-Zhong Yang

DOI: https://doi.org/10.48550/arXiv.2006.06210

2020-06-11

Applied Physics

Abstract:Accurate force sensing is important for endoluminal intervention in terms of both safety and lesion targeting. This paper develops an FBG-based force sensor for robotic bronchoscopy by configuring three FBG sensors at the lateral side of a conical substrate. It allows a large and eccentric inner lumen for the interventional instrument, enabling a flexible imaging probe inside to perform optical biopsy. The force sensor is embodied with a laser-profiled continuum robot and thermo drift is fully compensated by three temperature sensors integrated on the circumference surface of the sensor substrate. Different decoupling approaches are investigated, and nonlinear decoupling is adopted based on the cross-validation SVM and a Gaussian kernel function, achieving an accuracy of 10.58 mN, 14.57 mN and 26.32 mN along X, Y and Z axis, respectively. The tissue test is also investigated to further demonstrate the feasibility of the developed triaxial force sensor
Deep-Learning-Based Force Sensing Method for a Flexible Endovascular Surgery Robot

Chuqiao Lyu,Shuxiang Guo,Yonggan Yan,Yongxin Zhang,Yongwei Zhang,Pengfei Yang,Jianmin Liu

DOI: https://doi.org/10.1109/tim.2024.3381290

IF: 5.6

2024-04-05

IEEE Transactions on Instrumentation and Measurement

Abstract:Endovascular surgical robots (ESRs) are extensively researched because of their potential to minimize surgeons' radiation exposure. However, during the surgical operation, it is difficult for ESR to achieve the same flexibility in manipulating the soft catheter and the slender guidewire as human fingers. The flexibility of ESR can be enhanced by incorporating a soft gripper, but the nonlinear deformation of soft material presents challenges in sensing and controlling the force. To address these issues, this study proposes a deep-learning-based force sensing method that enables the flexible ESR to measure the surgical force and torque. The proposed deep-learning model consists of multiple-layer long short-term memory (LSTM) modules and is trained using the robot's motion and soft gripper deformation datasets. The well-trained LSTM model can predict the operating force and torque in real-time. The contrast experiments with other models demonstrate that our robot exhibits higher force measurement accuracy. Furthermore, a force control strategy is proposed for the application of LSTM-based ESR. In the force control strategy, the robot is encouraged to mimic the dexterity of the surgeon's fingers and to maintain the force within a safe range. Finally, the proposed strategy is compared with other strategies in vascular phantom experiments and is proven to effectively enhance the safety and efficiency of surgical operations.

engineering, electrical & electronic,instruments & instrumentation
Multi-Axis Force Sensing in Robotic Minimally Invasive Surgery With No Instrument Modification

A. H. Hadi-Hosseinabadi,S. E. Salcudean

DOI: https://doi.org/10.1109/LRA.2024.3355729

2021-03-20

Abstract:This paper presents a novel multi-axis force-sensing approach in robotic minimally invasive surgery with no modification to the surgical instrument. Thus, it is adaptable to different surgical instruments. A novel 6-axis optical force sensor, with local signal conditioning and digital electronics, was mounted onto the proximal shaft of a da Vinci EndoWrist instrument. A new cannula design comprising an inner tube and an outer tube was proposed. The inner tube is attached to the cannula interface to the robot base through a compliant leaf spring with adjustable stiffness. It allows bending of the instrument shaft due to the tip forces. The outer tube mechanically filters out the body forces from affecting the instrument bending behavior. A mathematical model of the sensing principle was developed and used for model-based calibration. A data-driven calibration based on a shallow neural network architecture comprising a single 5-nodes hidden layer and a 5x1 output layer is discussed. Extensive testing was conducted to validate that the sensor can successfully measure the lateral forces and moments and the axial torque applied to the instruments distal end within the desired resolution, accuracy, and range requirements.

Robotics,Systems and Control
A force-sensing surgical drill for real-time force feedback in robotic mastoidectomy

Yuxin Chen,Anna Goodridge,Manish Sahu,Aditi Kishore,Seena Vafaee,Harsha Mohan,Katherina Sapozhnikov,Francis Creighton,Russell Taylor,Deepa Galaiya

2023-04-06

Abstract:Purpose: Robotic assistance in otologic surgery can reduce the task load of operating surgeons during the removal of bone around the critical structures in the lateral skull base. However, safe deployment into the anatomical passageways necessitates the development of advanced sensing capabilities to actively limit the interaction forces between the surgical tools and critical anatomy. Methods: We introduce a surgical drill equipped with a force sensor that is capable of measuring accurate tool-tissue interaction forces to enable force control and feedback to surgeons. The design, calibration and validation of the force-sensing surgical drill mounted on a cooperatively controlled surgical robot are described in this work. Results: The force measurements on the tip of the surgical drill are validated with raw-egg drilling experiments, where a force sensor mounted below the egg serves as ground truth. The average root mean square error (RMSE) for points and path drilling experiments are 41.7 (pm 12.2) mN and 48.3 (pm 13.7) mN respectively. Conclusions: The force-sensing prototype measures forces with sub-millinewton resolution and the results demonstrate that the calibrated force-sensing drill generates accurate force measurements with minimal error compared to the measured drill forces. The development of such sensing capabilities is crucial for the safe use of robotic systems in a clinical context.

Robotics,Machine Learning,Signal Processing
Automatic tip detection of surgical instruments in biportal endoscopic spine surgery

Sue Min Cho,Young-Gon Kim,Jinhoon Jeong,Inhwan Kim,Ho-Jin Lee,Namkug Kim,Ho-jin Lee

DOI: https://doi.org/10.1016/j.compbiomed.2021.104384

IF: 7.7

2021-06-01

Computers in Biology and Medicine

Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Background</h3><p>Recent advances in robotics and deep learning can be used in endoscopic surgeries and can provide numerous advantages by freeing one of the surgeon's hands. This study aims to automatically detect the tip of the instrument, localize a point, and evaluate the detection accuracy in biportal endoscopic spine surgery (BESS). The tip detection could serve as a preliminary study for the development of vision intelligence in robotic endoscopy.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Methods</h3><p>The dataset contains 2310 frames from 9 BESS videos with x and y coordinates of the tip annotated by an expert. We trained two state-of-the-art detectors, RetinaNet and YOLOv2, with bounding boxes centered around the tip annotations with specific margin sizes to determine the optimal margin size for detecting the tip of the instrument and localizing the point. We calculated the recall, precision, and <em>F1</em>-score with a fixed box size for both ground truth tip coordinates and predicted midpoints to compare the performance of the models trained with different margin size bounding boxes.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results</h3><p>For RetinaNet, a margin size of 150 pixels was optimal with a recall of 1.000, precision of 0.733, and <em>F1</em>-score of 0.846. For YOLOv2, a margin size of 150 pixels was optimal with a recall of 0.864, precision of 0.808, <em>F1</em>-score of 0.835. Also, the optimal margin size of 150 pixels of RetinaNet was used to cross-validate its overall robustness. The resulting mean recall, precision, and <em>F1</em>-score were 1.000 ± 0.000, 0.767 ± 0.033, and 0.868 ± 0.022, respectively.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusions</h3><p>In this study, we evaluated an automatic tip detection method for surgical instruments in endoscopic surgery, compared two state-of-the-art detection algorithms, RetinaNet and YOLOv2, and validated the robustness with cross-validation. This method can be applied in different types of endoscopy tip detection.</p>

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology
A Modular 3-Degree-of-Freedom Force Sensor for Robot-assisted Minimally Invasive Surgery Research

Zonghe Chua,Allison M. Okamura

DOI: https://doi.org/10.48550/arXiv.2211.05428

IF: 3.7

2022-11-10

Robotics

Abstract:Effective force modulation during tissue manipulation is important for ensuring safe robot-assisted minimally invasive surgery (RMIS). Strict requirements for in-vivo distal force sensing have led to prior sensor designs that trade off ease of manufacture and integration against force measurement accuracy along the tool axis. These limitations have made collecting high-quality 3-degree-of-freedom (3-DoF) bimanual force data in RMIS inaccessible to researchers. We present a modular and manufacturable 3-DoF force sensor that integrates easily with an existing RMIS tool. We achieve this by relaxing biocompatibility and sterilizability requirements while utilizing commercial load cells and common electromechanical fabrication techniques. The sensor has a range of +-5 N axially and +-3 N laterally with average root mean square errors(RMSEs) of below 0.15 N in all directions. During teleoperated mock tissue manipulation tasks, a pair of jaw-mounted sensors achieved average RMSEs of below 0.15 N in all directions. For grip force, it achieved an RMSE of 0.156 N. The sensor has sufficient accuracy within the range of forces found in delicate manipulation tasks, with potential use in bimanual haptic feedback and robotic force control. As an open-source design, the sensors can be adapted to suit additional robotic applications outside of RMIS.
Endoluminal Motion Recognition of a Magnetically-Guided Capsule Endoscope Based on Capsule-Tissue Interaction Force

Peisen Zhang,Jing Li,Weimin Zhang,Yang Hao,Gastone Ciuti,Tatsuo Arai,Paolo Dario,Qiang Huang

DOI: https://doi.org/10.3390/s21072395

IF: 3.9

2021-03-30

Sensors

Abstract:A magnetically-guided capsule endoscope, embedding flexible force sensors, is designed to measure the capsule-tissue interaction force. The flexible force sensor is composed of eight force-sensitive elements surrounding the internal permanent magnet (IPM). The control of interaction force acting on the intestinal wall can reduce patient’s discomfort and maintain the magnetic coupling between the external permanent magnet (EPM) and the IPM during capsule navigation. A flexible force sensor can achieve this control. In particular, by analyzing the signals of the force sensitive elements, we propose a method to recognize the status of the motion of the magnetic capsule, and provide corresponding formulas to evaluate whether the magnetic capsule follows the motion of the external driving magnet. Accuracy of the motion recognition in Ex Vivo tests reached 94% when the EPM was translated along the longitudinal axis. In addition, a method is proposed to realign the EPM and the IPM before the loss of their magnetic coupling. Its translational error, rotational error, and runtime are 7.04 ± 0.71 mm, 3.13 ± 0.47∘, and 11.4 ± 0.39 s, respectively. Finally, a control strategy is proposed to prevent the magnetic capsule endoscope from losing control during the magnetically-guided capsule colonoscopy.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Evaluation of forces applied to tissues during robotic-assisted surgical tasks using a novel force feedback technology

Michael M. Awad,Mathew C. Raynor,Mika Padmanabhan-Kabana,Lana Y. Schumacher,Jeffrey A. Blatnik

DOI: https://doi.org/10.1007/s00464-024-11131-z

2024-09-14

Surgical Endoscopy

Abstract:The absence of force feedback (FFB) is considered a technical limitation in robotic-assisted surgery (RAS). This pre-clinical study aims to evaluate the forces applied to tissues using a novel integrated FFB technology, which allows surgeons to sense forces exerted at the instrument tips.

surgery
Design and Modelling of Continuum Robot for Endoscopic Submucosal Dissection Surgery With Lifting Force Estimation

Xingyao Zhang,Fuxin Du,Gang Zhang,Ke Wu,Gang Zheng,Yibin Li,Rui Song

DOI: https://doi.org/10.1002/rcs.2670

Abstract:Background: Endoscopic submucosal dissection (ESD) is an effective treatment for early-stage gastrointestinal cancers. However, traditional surgical instruments lack accuracy and force-sensing. Methods: A new type of continuum robot for ESD is designed. An accurate static model of the proposed continuum robot is established, considering cases where the robot bends into C-shapes and S-shapes. A force estimation method based on an accurate static model is proposed. Then, the accuracy of the static model and force estimation is verified through experiments. Finally, an ex-organ experiment is carried out. Results: The average position error of the proposed static model is 0.72 mm, accounting for 2.57% of the total robot length. The average error of force estimation is 19.53 mN. By gripping and cutting ex-porcine gastric mucosa, the robot's functionality is validated. Conclusion: This paper contributes to precise control and safe interaction of continuum robots.
Can you feel the force just right? Tactile force feedback for training of minimally invasive surgery—evaluation of vibration feedback for adequate force application

Felix von Bechtolsheim,Florian Bielert,Sofia Schmidt,Nathalie Buck,Sebastian Bodenstedt,Stefanie Speidel,Lisa-Marie Lüneburg,Thomas Müller,Yichen Fan,Tina Bobbe,Luca Oppici,Jens Krzywinski,Jakob Dobroschke,Jürgen Weitz,Marius Distler,Florian Oehme

DOI: https://doi.org/10.1007/s00464-024-10919-3

2024-06-05

Surgical Endoscopy

Abstract:Tissue handling is a crucial skill for surgeons and is challenging to learn. The aim of this study was to develop laparoscopic instruments with different integrated tactile vibration feedback by varying different tactile modalities and assess its effect on tissue handling skills.

surgery

A force-sensor improves trainee technique for rigid endoscopy

Force sensing in robot-assisted keyhole endoscopy: A systematic survey

Endoscope Force Generation and Intrinsic Sensing with Environmental Scaffolding

A Prospective Study on a Suture Force Feedback Device for Training and Evaluating Junior Surgeons in Anastomotic Surgical Closure

An EM-Tracked Approach for Calibrating the 3D Pose of Flexible Endoscopes

Colonic displacement as a marker of endoscopic skill: development of a novel tool for endoscopy training

A Sensor-less Catheter Contact Force Estimation Approach in Endovascular Intervention Procedures

FBG-Based Sensorized Surgical Instrument for Force Measurement in Minimally Invasive Robotic Surgery

Advancing Robotic Surgery: Affordable Kinesthetic and Tactile Feedback Solutions for Endotrainers

Triaxial Catheter-Tip Force Sensor for MRI-Guided Cardiac Procedures

A Micro‐3‐Degree‐of‐Freedom Force Sensor for Intraocular Dexterous Surgical Robots

FBG-Based Triaxial Force Sensor Integrated with an Eccentrically Configured Imaging Probe for Endoluminal Optical Biopsy

Deep-Learning-Based Force Sensing Method for a Flexible Endovascular Surgery Robot

Multi-Axis Force Sensing in Robotic Minimally Invasive Surgery With No Instrument Modification

A force-sensing surgical drill for real-time force feedback in robotic mastoidectomy

Automatic tip detection of surgical instruments in biportal endoscopic spine surgery

A Modular 3-Degree-of-Freedom Force Sensor for Robot-assisted Minimally Invasive Surgery Research

Endoluminal Motion Recognition of a Magnetically-Guided Capsule Endoscope Based on Capsule-Tissue Interaction Force

Evaluation of forces applied to tissues during robotic-assisted surgical tasks using a novel force feedback technology

Design and Modelling of Continuum Robot for Endoscopic Submucosal Dissection Surgery With Lifting Force Estimation

Can you feel the force just right? Tactile force feedback for training of minimally invasive surgery—evaluation of vibration feedback for adequate force application