[Importance and limits of rapidly ingested beta blockers in the differential diagnosis of changes in the repolarization phase].

R. Russo,F. Cacciapuoti,A. Grassia,S. Gentile,M. Varricchio,F. D'onofrio

Abstract:

What problem does this paper attempt to address?

Development and Control of A Robotic Arm for Percutaneous Surgery

Chunlin Zhou,Huifeng Wu,Xiang Xu,Yong Liu,Qi Zhu,Shuwen Pan

DOI: https://doi.org/10.1108/aa-12-2016-179

IF: 2.373

2017-01-01

Assembly Automation

Abstract:Purpose - The purpose of this paper is to propose a robotic system for percutaneous surgery. The key component in the system, a robotic arm that can manipulate a puncture needle is presented. The mechanical design, the motion control and the force control method of the robotic arm are discussed in the paper.Design/methodology/approach - The arm with an arc mechanism placed on a 3D Cartesian stage is developed as a puncture needle manipulator to locate the position of the needle tip, tune the needle's posture and actuate the puncture motion under the visual guidance of two orthogonal X-ray images of a patient by a surgeon. A focusing method by using two laser spots is proposed to automatically move the needle tip to a surgery entry point on the skin. A dynamics model is developed to control the position of the needle mechanism and an explicit force control strategy is utilized to perform the needle insertion.Findings - With the surgical system, a surgeon can easily perform puncture operation by taking two orthogonal real-time X-ray images as a visual feedback and accurately navigating the needle insertion. The laser-guided focusing method is efficient in placement of the needle tip. The explicit force control strategy is proved to be effective for holding constant and stable puncture force in experiments.Originality/value - The robotic arm has an advantage in easy redirection of the needle because the rotation and the translation are decoupled in the mechanism. By adopting simple laser pens and a well-developed kinematics model, the system can handle the entry point, locating task automatically. The focusing method and the force control method proposed in the paper are useful for the present system and could be intuitive for similar surgical robots.
Multimodal human–computer interaction in interventional radiology and surgery: a systematic literature review

Josefine Schreiter,Florian Heinrich,Benjamin Hatscher,Danny Schott,Christian Hansen

DOI: https://doi.org/10.1007/s11548-024-03263-3

2024-10-31

International Journal of Computer Assisted Radiology and Surgery

Abstract:As technology advances, more research dedicated to medical interactive systems emphasizes the integration of touchless and multimodal interaction (MMI). Particularly in surgical and interventional settings, this approach is advantageous because it maintains sterility and promotes a natural interaction. Past reviews have focused on investigating MMI in terms of technology and interaction with robots. However, none has put particular emphasis on analyzing these kind of interactions for surgical and interventional scenarios.

engineering, biomedical,radiology, nuclear medicine & medical imaging,surgery
Design and Quantitative Assessment of Teleoperation-Based Human–Robot Collaboration Method for Robot-Assisted Sonography

Weiyong Si,Ning Wang,Chenguang Yang

DOI: https://doi.org/10.1109/tase.2024.3350524

IF: 6.636

2024-01-01

IEEE Transactions on Automation Science and Engineering

Abstract:Tele-echography has emerged as a promising and effective solution, leveraging the expertise of sonographers and the autonomy of robots to perform ultrasound scanning for patients residing in remote areas, without the need for in-person visits by the sonographer. Designing effective and natural human-robot interfaces for tele-echography remains challenging, with patient safety being a critical concern. In this article, we develop a teleoperation system for robot-assisted sonography with two different interfaces, a haptic device-based interface and a low-cost 3D Mouse-based interface, which can achieve continuous and intuitive telemanipulation by a leader device with a small workspace. To achieve compliant interaction with patients, we design impedance controllers in Cartesian space to track the desired position and orientation for these two teleoperation interfaces. We also propose comprehensive evaluation metrics of robot-assisted sonography, including subjective and objective evaluation, to evaluate tele-echography interfaces and control performance. We evaluate the ergonomic performance based on the estimated muscle fatigue and the acquired ultrasound image quality. We conduct user studies based on the NASA Task Load Index to evaluate the performance of these two human-robot interfaces. The tracking performance and the quantitative comparison of these two teleoperation interfaces are conducted by the Franka Emika Panda robot. The results and findings provide guidance on human-robot collaboration design and implementation for robot-assisted sonography. Note to Practitioners—Robot-assisted sonography has demonstrated efficacy in medical diagnosis during clinical trials. However, deploying fully autonomous robots for ultrasound scanning remains challenging due to various constraints in practice, such as patient safety, dynamic tasks, and environmental uncertainties. Semi-autonomous or teleoperation-based robot sonography represents a promising approach for practical deployment. Previous work has produced various expensive teleoperation interfaces but lacks user studies to guide teleoperation interface selection. In this article, we present two typical teleoperation interfaces and implement a continuous and intuitive teleoperation control system. We also propose a comprehensive evaluation metric for assessing their performance. Our findings show that the haptic device outperforms the 3D Mouse, based on operators’ feedback and acquired image quality. However, the haptic device requires more learning time and effort in the training stage. Furthermore, the developed teleoperation system offers a solution for shared control and human-robot skill transfer. Our results provide valuable guidance for designing and implementing human-robot interfaces for robot-assisted sonography in practice.

automation & control systems
Interface Design and Control Strategies for a Robot Assisted Ultrasonic Examination System

François Conti,Jaeheung Park,Oussama Khatib

DOI: https://doi.org/10.1007/978-3-642-28572-1_7

2014-01-01

Abstract:This paper presents a new robotic system designed to assist sonographers in performing ultrasound examinations by addressing common limitations of sonography, namely the physical fatigue that can result from performing the examination, and the difficulty in interpreting ultrasound data. The proposed system comprises a robot manipulator that operates the transducer, and an integrated user interface that offers 3D visualization and a haptic device as the main user interaction tool. The sonographer controls the slave robot movements either haptically (collaborative tele-operation mode), or by prior programming of a desired path (semi-automatic mode). A force controller maintains a constant contact force between the transducer and the patient’s skin while the robot drives the transducer to the desired anatomical locations. The ultrasound imaging system is connected to a 3D visualization application which registers in real time the streaming 2D images generated by the transducer and displays the resulting data as 3D volumetric representation which can be further examined off-line.
Device- and System-Independent Personal Touchless User Interface for Operating Rooms

Meng MA,Pascal Fallavollita,Séverine Habert,Simon Weidert,Nassir Navab

DOI: https://doi.org/10.1007/s11548-016-1375-6

2016-01-01

International Journal of Computer Assisted Radiology and Surgery

Abstract:INTRODUCTION:In the modern day operating room, the surgeon performs surgeries with the support of different medical systems that showcase patient information, physiological data, and medical images. It is generally accepted that numerous interactions must be performed by the surgical team to control the corresponding medical system to retrieve the desired information. Joysticks and physical keys are still present in the operating room due to the disadvantages of mouses, and surgeons often communicate instructions to the surgical team when requiring information from a specific medical system. In this paper, a novel user interface is developed that allows the surgeon to personally perform touchless interaction with the various medical systems, switch effortlessly among them, all of this without modifying the systems' software and hardware.METHODS:To achieve this, a wearable RGB-D sensor is mounted on the surgeon's head for inside-out tracking of his/her finger with any of the medical systems' displays. Android devices with a special application are connected to the computers on which the medical systems are running, simulating a normal USB mouse and keyboard. When the surgeon performs interaction using pointing gestures, the desired cursor position in the targeted medical system display, and gestures, are transformed into general events and then sent to the corresponding Android device. Finally, the application running on the Android devices generates the corresponding mouse or keyboard events according to the targeted medical system.RESULTS AND CONCLUSION:To simulate an operating room setting, our unique user interface was tested by seven medical participants who performed several interactions with the visualization of CT, MRI, and fluoroscopy images at varying distances from them. Results from the system usability scale and NASA-TLX workload index indicated a strong acceptance of our proposed user interface.
Multi-Modal Interaction Control of Ultrasound Scanning Robots with Safe Human Guidance and Contact Recovery

Xiangjie Yan,Yongpeng Jiang,Guokun Wu,Chen Chen,Gao Huang,Xiang Li

DOI: https://doi.org/10.48550/arXiv.2302.05685

2023-02-11

Abstract:Ultrasound scanning robots enable the automatic imaging of a patient's internal organs by maintaining close contact between the ultrasound probe and the patient's body during a scanning procedure. Comprehensive, high-quality ultrasound scans are essential for providing the patient with an accurate diagnosis and effective treatment plan. An ultrasound scanning robot usually works in a doctor-robot co-existing environment, hence both efficiency and safety during the collaboration should be considered. In this paper, we propose a novel multi-modal control scheme for ultrasound scanning robots, in which three interaction modes are integrated into a single control input. Specifically, the scanning mode drives the robot to track a time-varying trajectory on the patient's body under the desired impedance model; the recovery mode allows the robot to actively recontact the body whenever physical contact between the ultrasound probe and the patient's body is lost; the human-guided mode renders the robot passive such that the doctor can safely intervene to manually reposition the probe. The integration of multiple modes allows the doctor to intervene safely at any time during the task and also maximizes the robot's autonomous scanning ability. The performance of the robot is validated on a collaborative scanning task of a carotid artery examination.

Robotics
Modified classic risk factors for coronary artery disease in Chinese Han population.

H. Cui,Sheng-huang Wang,Dong-qi Wang,Chang-cong Cui,Xin-yi Chen,Xiao-Min Chen,Zheng Zhang,Hong-kao Zhang,Fengjiao Bai,J. Muhlestein

2007-12-01

Abstract:OBJECTIVE To investigate the levels of cardiovascular disease risk factors and their relations to clinical phenotype associated with coronary artery disease (CAD). METHODS The subjects were recruited from five independent cardiovascular centers. Coronary angiography was employed to define the CAD with stenosis in each major vessel > or = 70% and control with stenosis < 10% in every lesion. The classic risk factors including family history, body mass index, smoking habits, hypertension, diabetes mellitus, and serum lipid levels were surveyed according to established criteria. Associations between risk levels and clinical phenotypes were assessed by case control and correlation analysis. RESULTS A total of 762 individuals were collected, including 481 men and 281 women, aged from 17 to 81 (mean 60 +/- 10) years. The patients with CAD accounted for 55.5% of all participants, and controls 44.5%, respectively. Compared with the pattern in published data, our study showed that mean serum high density lipoprotein cholesterol (HDL-C) level was significantly lower (P < 0.001) and triglycerides was significantly higher (P < 0.001), while total cholesterol (TC) and low density lipoprotein cholesterol levels were comparative (both P > 0.05). The prevalence of low HDL-C (< 40 g/L) and hypertriglyceridemia (> 150 g/L) were 27.2% and 41.4%, respectively. Mean serum levels of HDL-C and apolipoprotein A1 were significantly higher in female subjects than in male (P < 0.001). Lower HDL-C functioned as an independent risk factor for CAD only in men (RR = 2.8, 95% CI: 1.5-4. 2, P < 0.001), yet increased non-HDL cholesterol combined with diabetes mellitus and obesity seemed to play a key role in the development of CAD in women. Similarity in risk association with CAD was found for hypertension and TC/HDL ratio in male and female subjects, while family history had no relationship with the presence of CAD. CONCLUSION It is remarkable that emphasis of intervention in future should be given on the prevalent low serum HDL-C and its strong risk correlation with the presence of CAD in male subjects of Chinese Han population.
Multi-silicone bilateral soft physical twin as an alternative to traditional user interfaces for remote palpation: a comparative study

Leone Costi,Fumiya Iida

DOI: https://doi.org/10.1038/s41598-023-50329-4

2023-12-27

Abstract:Teleoperated medical technologies are a fundamental part of the healthcare system. From telemedicine to remote surgery, they allow remote diagnosis and treatment. However, the absence of any interface able to effectively reproduce the sense of touch and interaction with the patient prevents the implementation of teleoperated systems for primary care examinations, such as palpation. In this paper, we propose the first reported case of a soft robotic bilateral physical twin for remote palpation. By creating an entirely soft interface that can be used both to control the robot and receive feedback, the proposed device allows the user to achieve remote palpation by simply palpating the soft physical twin. This is achieved through a compact design showcasing 9 pneumatic chambers and exploiting multi-silicone casting to minimize cross-noise and allow teleoperation. A comparative study has been run against a traditional setup, and both the control and feedback of the physical twin are carefully analyzed. Despite distributed tactile feedback not achieving the same performance as the visual map, the soft control and visual feedback combination showcases a 5.1% higher accuracy. Moreover, the bilateral soft physical twin results always in a less invasive procedure, with 41% lower mechanical work exchanged with the remote phantom.
Multi-Modal Autonomous Ultrasound Scanning for Efficient Human–Machine Fusion Interaction

Chengwen Luo,Yuhao Chen,Haozheng Cao,Mustafa A. Al Sibahee,Weitao Xu,Jin Zhang

DOI: https://doi.org/10.1109/tase.2024.3370728

IF: 6.636

2024-01-01

IEEE Transactions on Automation Science and Engineering

Abstract:Robotic autonomous ultrasound imaging is a challenging task as robots require strong analytical capabilities to make sound decisions in complex spatial relationships. In this paper, we integrate visual and tactile information into the ultrasound robotic system drawing inspiration from the process of human doctors conducting ultrasound scans, and explore the impact of different modalities of information on our task. The proposed multimodal deep reinforcement learning (DRL) framework can integrate real-time visual feedback and tactile perception, and directly output 6D pose decisions to control the ultrasound probe, thereby achieving fully autonomous ultrasound imaging of soft, movable, and unmarked targets. We demonstrate the feasibility of our method on a simulation platform and propose an effective model transfer learning method. Subsequently, we conducted further evaluations of the approach in a real-world environment. The results indicate that our approach effectively enhances the performance of autonomous ultrasound scanning and manual adjustments further optimize the outcomes. Note to Practitioners—This work is motivated by the increasing demand for intelligent human-machine interaction in medical applications. By improving the automation of traditional medical scanning procedures such as ultrasound scanning, the efficiency of medical scanning can be greatly improved. In this work, we propose a multi-modal autonomous ultrasound scanning system based on DRL, which can be applied to improve the efficiency of human-machine interaction in medical environments to execute daily health screening or used in emergency situations.

automation & control systems
Face mediated human-robot interaction for remote medical examination

Thilina D Lalitharatne,Leone Costi,Ryman Hashem,Ilana Nisky,Rachael E Jack,Thrishantha Nanayakkara,Fumiya Iida

DOI: https://doi.org/10.1038/s41598-022-16643-z

2022-07-22

Abstract:Realtime visual feedback from consequences of actions is useful for future safety-critical human-robot interaction applications such as remote physical examination of patients. Given multiple formats to present visual feedback, using face as feedback for mediating human-robot interaction in remote examination remains understudied. Here we describe a face mediated human-robot interaction approach for remote palpation. It builds upon a robodoctor-robopatient platform where user can palpate on the robopatient to remotely control the robodoctor to diagnose a patient. A tactile sensor array mounted on the end effector of the robodoctor measures the haptic response of the patient under diagnosis and transfers it to the robopatient to render pain facial expressions in response to palpation forces. We compare this approach against a direct presentation of tactile sensor data in a visual tactile map. As feedback, the former has the advantage of recruiting advanced human capabilities to decode expressions on a human face whereas the later has the advantage of being able to present details such as intensity and spatial information of palpation. In a user study, we compare these two approaches in a teleoperated palpation task to find the hard nodule embedded in the remote abdominal phantom. We show that the face mediated human-robot interaction approach leads to statistically significant improvements in localizing the hard nodule without compromising the nodule position estimation time. We highlight the inherent power of facial expressions as communicative signals to enhance the utility and effectiveness of human-robot interaction in remote medical examinations.
Dual Mode pHRI-teleHRI Control System with a Hybrid Admittance-Force Controller for Ultrasound Imaging

Teng Li,Xiao Meng,Mahdi Tavakoli

DOI: https://doi.org/10.3390/s22114025

IF: 3.9

2022-05-26

Sensors

Abstract:The COVID-19 pandemic has brought unprecedented extreme pressure on the medical system due to the physical distance policy, especially for procedures such as ultrasound (US) imaging, which are usually carried out in person. Tele-operation systems are a promising way to avoid physical human–robot interaction (pHRI). However, the system usually requires another robot on the remote doctor side to provide haptic feedback, which makes it expensive and complex. To reduce the cost and system complexity, in this paper, we present a low-cost, easy-to-use, dual-mode pHRI-teleHRI control system with a custom-designed hybrid admittance-force controller for US imaging. The proposed system requires only a tracking camera rather than a sophisticated robot on the remote side. An audio feedback is designed for replacing haptic feedback on the remote side, and its sufficiency is experimentally verified. The experimental results indicate that the designed hybrid controller can significantly improve the task performance in both modes. Furthermore, the proposed system enables the user to conduct US imaging while complying with the physical distance policy, and allows them to seamlessly switch modes from one to another in an online manner. The novel system can be easily adapted to other medical applications beyond the pandemic, such as tele-healthcare, palpation, and auscultation.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Evaluation of User‐Interfaces for Controlling Movements of Virtual Minimally Invasive Surgical Instruments

Dehlela Shabir,Malek Anbatawi,Jhasketan Padhan,Shidin Balakrishnan,Abdulla Al‐Ansari,Julien Abinahed,Panagiotis Tsiamyrtzis,Elias Yaacoub,Amr Mohammed,Zhigang Deng,Nikhil V. Navkar

DOI: https://doi.org/10.1002/rcs.2414

2022-04-29

Abstract:BACKGROUND: Recent tele-mentoring technologies for minimally invasive surgery (MIS) augments the operative field with movements of virtual surgical instruments as visual cues. The objective of this work is to assess different user-interfaces that effectively transfer mentor's hand gestures to the movements of virtual surgical instruments.METHODS: A user study was conducted to assess three different user-interface devices (Oculus-Rift, SpaceMouse, Touch Haptic device) under various scenarios. The devices were integrated with a MIS tele-mentoring framework for control of both manual and robotic virtual surgical instruments.RESULTS: The user study revealed that Oculus Rift is preferred during robotic scenarios, whereas the touch haptic device is more suitable during manual scenarios for tele-mentoring.CONCLUSION: A user-interface device in the form of a stylus controlled by fingers for pointing in 3D space is more suitable for manual MIS, whereas a user-interface that can be moved and oriented easily in 3D space by wrist motion is more suitable for robotic MIS.
Unconstrained lightweight control interface for robot-assisted minimally invasive surgery using MediaPipe framework and head-mounted display

Wounsuk Rhee,Young Gyun Kim,Jong Hyeon Lee,Jae Woo Shim,Byeong Soo Kim,Dan Yoon,Minwoo Cho,Sungwan Kim

DOI: https://doi.org/10.1007/s10055-024-00986-1

IF: 4.697

2024-05-24

Virtual Reality

Abstract:Robotic surgery is preferred over open or laparoscopic surgeries due to its intuitiveness and convenience. However, prolonged use of surgical robots can cause neck pain and joint fatigue in wrist and fingers. Also, input systems are bulky and difficult to maintain. To resolve these issues, we propose a novel input module based on real-time 3D hand tracking driven by RGB images and MediaPipe framework to control surgical robots such as patient side manipulator (PSM) and endoscopic camera manipulator (ECM) of da Vinci research kit. In this paper, we explore the mathematical basis of the proposed 3D hand tracking module and provide a proof-of-concept through user experience (UX) studies conducted in a virtual environment. End-to-end latencies for controlling PSM and ECM were 170 ± 10 ms and 270 ± 10 ms, respectively. Of fifteen novice participants recruited for the UX study, thirteen managed to reach a qualifiable level of proficiency after 50 min of practice and fatigue of hand and wrist were imperceivable. Therefore, we concluded that we have successfully developed a robust 3D hand tracking module for surgical robot control and in the future, it would hopefully reduce hardware cost and volume as well as resolve ergonomic problems. Furthermore, RGB image driven 3D hand tracking module developed in our study can be widely applicable to diverse fields such as extended reality (XR) development and remote robot control. In addition, we provide a new standard for evaluating novel input modalities of XR environments from a UX perspective.

computer science, interdisciplinary applications, software engineering,imaging science & photographic technology
A Novel Ultrasound Robot With Force/Torque Measurement and Control for Safe and Efficient Scanning

Xianqiang Bao,Shuangyi Wang,Lingling Zheng,Richard James Housden,Joseph Hajnal,Kawal Rhode

DOI: https://doi.org/10.1109/tim.2023.3239925

IF: 5.6

2023-02-16

IEEE Transactions on Instrumentation and Measurement

Abstract:Medical ultrasound (US) is of increasing importance in medical diagnosis and intraoperative assistance and possesses great potential advantages when integrated with robotics. However, some concerns, including the operation efficiency, operation safety, image quality, and comfort of patients, remain after introducing robotics into medical ultrasound. In this article, an ultrasound robot integrating a force control mechanism, force/torque measurement mechanism, and online adjustment method is proposed to overcome the current limitations. The ultrasound robot can measure operating forces and torques, provide adjustable constant operating forces, eliminate great operating forces introduced by accidental operations, and achieve various scanning depths based on clinical requirements. The proposed ultrasound robot would potentially facilitate sonographers to find the targets quickly, improve operation safety and efficiency, and decrease patients' discomfort. Simulations and experiments were carried out to evaluate the performance of the ultrasound robot. Experimental results show that the proposed ultrasound robot is able to detect operating force in the -direction and torques around the - and -directions with errors of 3.53%, 6.68%, and 6.11% F.S., maintain the constant operating force with errors of less than 0.57 N, and achieve various scanning depths for target searching and imaging. This proposed ultrasound robot has good performance and would potentially be used in medical ultrasound.

engineering, electrical & electronic,instruments & instrumentation
A Unified Interaction Control Framework for Safe Robotic Ultrasound Scanning with Human-Intention-Aware Compliance

Xiangjie Yan,Shaqi Luo,Yongpeng Jiang,Mingrui Yu,Chen Chen,Senqiang Zhu,Gao Huang,Shiji Song,Xiang Li

2024-11-29

Abstract:The ultrasound scanning robot operates in environments where frequent human-robot interactions occur. Most existing control methods for ultrasound scanning address only one specific interaction situation or implement hard switches between controllers for different situations, which compromises both safety and efficiency. In this paper, we propose a unified interaction control framework for ultrasound scanning robots capable of handling all common interactions, distinguishing both human-intended and unintended types, and adapting with appropriate compliance. Specifically, the robot suspends or modulates its ongoing main task if the interaction is intended, e.g., when the doctor grasps the robot to lead the end effector actively. Furthermore, it can identify unintended interactions and avoid potential collision in the null space beforehand. Even if that collision has happened, it can become compliant with the collision in the null space and try to reduce its impact on the main task (where the scan is ongoing) kinematically and dynamically. The multiple situations are integrated into a unified controller with a smooth transition to deal with the interactions by exhibiting human-intention-aware compliance. Experimental results validate the framework's ability to cope with all common interactions including intended intervention and unintended collision in a collaborative carotid artery ultrasound scanning task.

Robotics
Assessment of Mitral Annular and Velocity Vector Imaging in Acute Myopericarditis

M. Lynch,Robert E O'donnell,N. Weintraub,A. López-Candales

DOI: https://doi.org/10.1111/echo.12278

2013-09-01

Echocardiography

Abstract:A 25‐year‐old student presenting with pleuritic chest pain, elevated troponin levels and subtle electrocardiogram abnormalities was treated for presumptive myopericarditis. On echocardiography, a lower than expected mitral annular displacement and systolic velocity were identified along with abnormalities in left ventricular strain generation that matched areas of edema and necrosis by cardiac magnetic resonance imaging. The patient was treated with nonsteroidal antiinflammatory drugs and colchicine, and both the symptoms and echocardiographic abnormalities rapidly resolved. These novel findings suggest that changes in mitral annular displacement and systolic velocity occur in acute myopericarditis and may be useful in following the course of the disease
Development of an Intuitive Interface with Haptic Enhancement for Robot-Assisted Endovascular Intervention.

Wenke Duan,Zihao Li,Olatunji M Omisore,Wenjing Du,Toluwanimi O Akinyemi,Xingyu Chen,Xing Gao,Hongbo Wang,Lei Wang

DOI: https://doi.org/10.1109/toh.2023.3346479

IF: 3.105

2023-01-01

IEEE Transactions on Haptics

Abstract:Robot-assisted endovascular intervention has the potential to reduce radiation exposure to surgeons and enhance outcomes of interventions. However, the success and safety of endovascular interventions depend on surgeons' ability to accurately manipulate endovascular tools such as guidewire and catheter and perceive their safety when cannulating patient's vessels. Currently, the existing interventional robots lack a haptic system for accurate force feedback that surgeons can rely on. In this paper, a haptic-enabled endovascular interventional robot was developed. We proposed a dynamic hysteresis compensation model to address the challenges of hysteresis and nonlinearity in magnetic powder brake-based haptic interface, which were used for providing high-precision and higher dynamic range haptic perception. Also, for the first time, a human perceptual-based haptic enhancement model and safety strategy were integrated with the custom-built haptic interface for enhancing sensation discrimination ability during robot-assisted endovascular interventions. This can effectively amplify even subtle changes in low-intensity operational forces such that surgeons can better discern any vessel-tools interaction force. Several experimental studies were performed to show that the haptic interface and the kinesthetic perception enhancement model can enhance the transparency of robot-assisted endovascular interventions, as well as promote the safety awareness of surgeon.
A Human Microrobot Interface Based on Acoustic Manipulation.

Xiaolong Lu,Kangdong Zhao,Wenjuan Liu,Dongxin Yang,Hui Shen,Hanmin Peng,Xiasheng Guo,Jinxing Li,Joseph Wang

DOI: https://doi.org/10.1021/acsnano.9b04930

IF: 17.1

2019-01-01

ACS Nano

Abstract:Micro/nanorobotic systems capable of targeted transporting and releasing hold considerable promise for drug delivery, cellular surgery, biosensing, nano assembling, etc. However, on-demand precise control of the micro/nanorobot movement remains a major challenge. In particular, a practical interface to realize instant and customized interactions between human and micro/nanorobots, which is quite essential for developing next generation intelligent micro/nanorobots, has seldom been explored. Here, we present a human-microrobot user interface to perform direct and agile recognition of user commands and signal conversion for driving the microrobot. The microrobot platform is built based on locally enhanced acoustic streaming which could precisely transport microparticles and cells along a given pathway, while the interface is enabled by tuning the actuation frequency and time with different instructions and inputs. Our numerical simulations and experimental demonstrations illustrate that microparticles can be readily transported along the path by the acoustic robotic system, due to the vibration-induced locally enhanced acoustic streaming and resultant propulsion force. The acoustic robotic platform allows large-scale parallel transportation for microparticles and cells along given paths. The human microrobot interface enables the micromanipulator to response promptly to the users' commands input by typing or music playing for accurate transport. For example, the music tone of a playing melody is used for manipulating a cancer cell to a targeted position. The interface offers several attractive capabilities, including tunable speed and orientation, quick response, considerable delivery capacities, high precision and favorable controllability. We expect that such interface will work as a compelling and versatile platform for myriad potential scenarios in transportation units of microrobots, single cell analysis instruments, lab-on-chip systems, microfactories, etc.

[Importance and limits of rapidly ingested beta blockers in the differential diagnosis of changes in the repolarization phase].

Development and Control of A Robotic Arm for Percutaneous Surgery

Multimodal human–computer interaction in interventional radiology and surgery: a systematic literature review

Design and Quantitative Assessment of Teleoperation-Based Human–Robot Collaboration Method for Robot-Assisted Sonography

Interface Design and Control Strategies for a Robot Assisted Ultrasonic Examination System

Device- and System-Independent Personal Touchless User Interface for Operating Rooms

Multi-Modal Interaction Control of Ultrasound Scanning Robots with Safe Human Guidance and Contact Recovery

Modified classic risk factors for coronary artery disease in Chinese Han population.

Multi-silicone bilateral soft physical twin as an alternative to traditional user interfaces for remote palpation: a comparative study

Multi-Modal Autonomous Ultrasound Scanning for Efficient Human–Machine Fusion Interaction

Face mediated human-robot interaction for remote medical examination

Dual Mode pHRI-teleHRI Control System with a Hybrid Admittance-Force Controller for Ultrasound Imaging

Evaluation of User‐Interfaces for Controlling Movements of Virtual Minimally Invasive Surgical Instruments

Unconstrained lightweight control interface for robot-assisted minimally invasive surgery using MediaPipe framework and head-mounted display

A Novel Ultrasound Robot With Force/Torque Measurement and Control for Safe and Efficient Scanning

A Unified Interaction Control Framework for Safe Robotic Ultrasound Scanning with Human-Intention-Aware Compliance

Assessment of Mitral Annular and Velocity Vector Imaging in Acute Myopericarditis

Development of an Intuitive Interface with Haptic Enhancement for Robot-Assisted Endovascular Intervention.

A Human Microrobot Interface Based on Acoustic Manipulation.