The IDEAL framework for surgical robotics: development, comparative evaluation and long-term monitoring

Aswin Chari,Fanny Ficuciello,Effy Vayena,Christopher Baber,Marco Zenati,Alan Kuntz,Karen Kerr,Nigel Horwood,Katherine Anderon,Ka-Wai Kwok,Rich Mahoney,Bill Peine,Ferdinando Rodriquez Y. Baena,Pietro Valdastri,Richard Leparmentier,Len Evans,Rebecca Langley,Garnette Sutherland,Sanju Lama,Naeem Soomro,Justin Collins,Mario M. Leitao,James Kinross,Alvin Goh,Bernard Park,Matthias Weigl,Rebecca Randell,Steven Yule,Duncan McPherson,Laura Pickup,Richard Skipworth,Jennifer Anger,Denny Yu,Lora Cavuoto,Ann Bisantz,Tara Cohen,Mirre Scholte,Guy Maddern,Laura Sampietro-Colom,Alane Clark,Tammy J. Clifford,Belen Corbacho,Cynthia Iglesias,Janneke Grutters,Katrina Hutchinson,Lesley Booth,Heather Draper,Len Evans,Sarah Goering,Alexander A. Kon,Rebecca Langley,Rob Sparrow,Kamran Ahmed,Deena Harji,Teodor Grantcharov,Lars Konge,Hani J. Marcus,Pedro T. Ramirez,Danyal Z. Khan,Hugo Layard Horsfall,John G. Hanrahan,Simon C. Williams,David J. Beard,Rani Bhat,Ken Catchpole,Andrew Cook,Katrina Hutchison,Janet Martin,Tom Melvin,Danail Stoyanov,Maroeska Rovers,Nicholas Raison,Prokar Dasgupta,David Noonan,Deborah Stocken,Georgia Sturt,Anne Vanhoestenberghe,Baptiste Vasey,Peter McCulloch,The IDEAL Robotics Colloquium,Panel 1. Artificial intelligence,Panel 2. Technical evaluation,Panel 3. Clinical evaluation,Panel 4. Human factors,Panel 5. Health economics,Panel 6. Ethics,Panel 7. Surgical training

DOI: https://doi.org/10.1038/s41591-023-02732-7

IF: 82.9

2024-01-21

Nature Medicine

Abstract:The next generation of surgical robotics is poised to disrupt healthcare systems worldwide, requiring new frameworks for evaluation. However, evaluation during a surgical robot's development is challenging due to their complex evolving nature, potential for wider system disruption and integration with complementary technologies like artificial intelligence. Comparative clinical studies require attention to intervention context, learning curves and standardized outcomes. Long-term monitoring needs to transition toward collaborative, transparent and inclusive consortiums for real-world data collection. Here, the Idea, Development, Exploration, Assessment and Long-term monitoring (IDEAL) Robotics Colloquium proposes recommendations for evaluation during development, comparative study and clinical monitoring of surgical robots—providing practical recommendations for developers, clinicians, patients and healthcare systems. Multiple perspectives are considered, including economics, surgical training, human factors, ethics, patient perspectives and sustainability. Further work is needed on standardized metrics, health economic assessment models and global applicability of recommendations.

biochemistry & molecular biology,cell biology,medicine, research & experimental

What problem does this paper attempt to address?

The main problems that this paper attempts to solve are the deficiencies of the existing surgical robot evaluation frameworks, especially in the face of the complexity and challenges brought by the new - generation surgical robots. Specifically:

1. **Limitations of the evaluation framework**: Current evaluation methods cannot fully cope with the complexity and rapidly evolving characteristics of surgical robots. In particular, there are many challenges in their evaluation during the development stage. These challenges include problems in multiple aspects such as technical evaluation, clinical evaluation, human factors engineering, health economics, ethics, and surgical training.

2. **Lack of standardized indicators**: Existing evaluation methods lack standardized evaluation indicators. Especially in early - stage research, there are problems such as design flaws, reporting bias, and methodological heterogeneity. This has led to a lack of systematic and transparent evaluation of the performance and safety of robotic surgery systems.

3. **Economic value and sustainability**: The evaluation of surgical robots needs to consider their economic value and long - term sustainability in the medical system, but the existing evaluation frameworks pay insufficient attention to this.

4. **Ethical and social impacts**: With the integration of artificial intelligence technology, the ethical and social impacts of surgical robots become more complex, and new evaluation methods are required to ensure the safe and fair use of these systems.

To address these problems, the paper proposes the IDEAL framework (Idea, Development, Exploration, Assessment, and Long - term monitoring), which is a comprehensive evaluation path aimed at guiding the development, comparative studies, and clinical monitoring of surgical robots. This framework particularly emphasizes the following aspects of improvement:

- **Multidisciplinary cooperation**: Through the cooperation of international multidisciplinary expert groups, ensure the comprehensiveness and diversity of the evaluation.
- **Patient participation**: Incorporate patient representatives in the evaluation process to ensure that the patients' perspectives and needs are fully considered.
- **Transparency and traceability**: Require transparent recording and reporting of device iterative modifications and evaluation results to improve the credibility of the evaluation.
- **Standardized evaluation indicators**: Define standardized technical and clinical evaluation indicators to ensure the consistency and comparability of the evaluation.
- **Economic and environmental sustainability**: Conduct early economic and environmental sustainability evaluations to guide the efficient development and application of surgical robots.

In summary, this paper aims to provide a structured and multi - dimensional guidance plan for the development and evaluation of surgical robots by proposing the IDEAL framework, so as to ensure the safe, effective, and sustainable development of these technologies.